"./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose" - Starting (try 1/5)
2024/11/07 01:18:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-balilof8moti"
2024/11/07 01:18:36 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2024/11/07 01:18:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : Creating backend with remote "/tmp/rclone1477463621"
=== RUN   TestBisyncRemoteLocal
2024/11/07 01:18:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego"
2024/11/07 01:18:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 NOTICE: remote: TestHdfs:rclone-test-jisagow5dego
=== RUN   TestBisyncRemoteLocal/all_changed
2024/11/07 01:18:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:36 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2024/11/07 01:18:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:36 DEBUG : path1: Making directory
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:36 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/all_changed/path1"
2024/11/07 01:18:36 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:36 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:36 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:36 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1"
2024/11/07 01:18:36 DEBUG : Creating backend with remote "/tmp/011836si"
2024/11/07 01:18:36 DEBUG : Creating backend with remote "/tmp/011836si/all_changed/path2"
2024/11/07 01:18:36 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_all_changed/initial"
2024/11/07 01:18:36 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_all_changed-tereyub3"
2024/11/07 01:18:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:36 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:36 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : Local file system at /tmp/011836si/initdir/test_all_changed-tereyub3: Waiting for checks to finish
2024/11/07 01:18:36 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:36 DEBUG : Local file system at /tmp/011836si/initdir/test_all_changed-tereyub3: Waiting for transfers to finish
2024/11/07 01:18:36 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:36 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:36 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:36 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:36 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:36 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:36 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:36 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:36 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:36 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: list [/rclone-test-jisagow5dego/011836si/all_changed/path1]
2024/11/07 01:18:36 ERROR : : error listing: directory not found
2024/11/07 01:18:36 ERROR : : error listing: directory not found
2024/11/07 01:18:36 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_all_changed-tereyub3
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: list [/rclone-test-jisagow5dego/011836si/all_changed/path1]
2024/11/07 01:18:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : subdir: Making directory
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: mkdir [/rclone-test-jisagow5dego/011836si/all_changed/path1/subdir]
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/file1.copy1.txt]
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/RCLONE_TEST]
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/file1.copy2.txt]
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/file1.copy3.txt]
2024/11/07 01:18:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: Waiting for checks to finish
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: Waiting for transfers to finish
2024/11/07 01:18:36 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/file1.copy4.txt]
2024/11/07 01:18:36 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/file1.copy5.txt]
2024/11/07 01:18:36 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/file1.txt]
2024/11/07 01:18:36 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: update [/rclone-test-jisagow5dego/011836si/all_changed/path1/subdir/file20.txt]
2024/11/07 01:18:36 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:36 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:36 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-jisagow5dego/011836si/all_changed/path1/RCLONE_TEST: replication in progress)
2024/11/07 01:18:36 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2024/11/07 01:18:36 DEBUG : pacer: low level retry 2/10 (error create /rclone-test-jisagow5dego/011836si/all_changed/path1/RCLONE_TEST: replication in progress)
2024/11/07 01:18:36 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2024/11/07 01:18:36 DEBUG : pacer: Reducing sleep to 60ms
2024/11/07 01:18:36 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:36 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: list [/rclone-test-jisagow5dego/011836si/all_changed/path1]
2024/11/07 01:18:36 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/all_changed/path1: list [/rclone-test-jisagow5dego/011836si/all_changed/path1/subdir]
2024/11/07 01:18:36 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:36 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:36 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:36 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:36 DEBUG : Local file system at /tmp/011836si/all_changed/path2: Waiting for checks to finish
2024/11/07 01:18:36 DEBUG : Local file system at /tmp/011836si/all_changed/path2: Waiting for transfers to finish
2024/11/07 01:18:36 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:36 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:36 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:36 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:36 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:36 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:36 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:36 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:36 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:36 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:36 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:36 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 NOTICE: checking path2 Local file system at /tmp/011836si/all_changed/path2
2024/11/07 01:18:36 NOTICE: (01)  : test all-changed
2024/11/07 01:18:36 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:36 NOTICE: (03)  : bisync resync
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:36 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:36 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" with Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:36 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:36 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:36 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:36 INFO  : Resync updating listings
2024/11/07 01:18:36 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" vs Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:36 INFO  : Bisync successful
2024/11/07 01:18:36 NOTICE: (04)  : test change timestamp on all files except RCLONE_TEST
2024/11/07 01:18:36 NOTICE: (05)  : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/all_changed/path1/ file*
2024/11/07 01:18:36 NOTICE: (06)  : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/all_changed/path1/subdir file*
2024/11/07 01:18:36 NOTICE: (07)  : test sync should pass
2024/11/07 01:18:36 NOTICE: (08)  : bisync
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:36 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:36 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" with Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:36 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:36 INFO  : Path1 checking for diffs
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - file1.copy1.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - file1.copy2.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - file1.copy3.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - file1.copy4.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - file1.copy5.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - subdir/file20.txt
2024/11/07 01:18:36 INFO  : Path1:    7 changes:    0 new,    7 modified,    0 deleted
2024/11/07 01:18:36 INFO  : (Modified:    7 newer,    0 older)
2024/11/07 01:18:36 INFO  : Path2 checking for diffs
2024/11/07 01:18:36 INFO  : Applying changes
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy1.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy2.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy3.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy4.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy5.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/subdir/file20.txt
2024/11/07 01:18:36 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:36 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 INFO  : Updating listings
2024/11/07 01:18:36 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" vs Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:36 INFO  : Bisync successful
2024/11/07 01:18:36 NOTICE: (09)  : test change timestamp on all files including RCLONE_TEST
2024/11/07 01:18:36 NOTICE: (10)  : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/all_changed/path1/ *
2024/11/07 01:18:36 NOTICE: (11)  : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/all_changed/path1/subdir *
2024/11/07 01:18:36 NOTICE: (12)  : test sync should fail
2024/11/07 01:18:36 NOTICE: (13)  : bisync
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:36 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:36 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" with Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:36 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:36 INFO  : Path1 checking for diffs
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - RCLONE_TEST
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy1.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy2.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy3.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy4.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy5.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - subdir/file20.txt
2024/11/07 01:18:36 INFO  : Path1:    8 changes:    0 new,    8 modified,    0 deleted
2024/11/07 01:18:36 INFO  : (Modified:    1 newer,    7 older)
2024/11/07 01:18:36 INFO  : Path2 checking for diffs
2024/11/07 01:18:36 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/". Run with --force if desired.
2024/11/07 01:18:36 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:18:36 NOTICE: Bisync error: all files were changed
2024/11/07 01:18:36 NOTICE: (14)  : test sync with force should pass
2024/11/07 01:18:36 NOTICE: (15)  : bisync force
2024/11/07 01:18:36 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:36 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:36 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:36 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" with Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:36 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:36 INFO  : Path1 checking for diffs
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (newer) - RCLONE_TEST
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy1.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy2.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy3.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy4.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.copy5.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - file1.txt
2024/11/07 01:18:36 INFO  : - Path1    File changed: time (older) - subdir/file20.txt
2024/11/07 01:18:36 INFO  : Path1:    8 changes:    0 new,    8 modified,    0 deleted
2024/11/07 01:18:36 INFO  : (Modified:    1 newer,    7 older)
2024/11/07 01:18:36 INFO  : Path2 checking for diffs
2024/11/07 01:18:36 INFO  : Applying changes
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/RCLONE_TEST
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy1.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy2.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy3.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy4.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.copy5.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/file1.txt
2024/11/07 01:18:36 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/all_changed/path2/subdir/file20.txt
2024/11/07 01:18:36 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:36 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:18:36 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (replaced existing)
2024/11/07 01:18:37 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:37 INFO  : Updating listings
2024/11/07 01:18:37 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/all_changed/path1/" vs Path2 "/tmp/011836si/all_changed/path2/"
2024/11/07 01:18:37 INFO  : Bisync successful
    bisync_test.go:558: TEST all_changed PASSED
=== RUN   TestBisyncRemoteLocal/backupdir
2024/11/07 01:18:37 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:37 DEBUG : path1: Making directory
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:37 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/backupdir/path1"
2024/11/07 01:18:37 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:37 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:37 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/backupdir/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/backupdir/path1"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/backupdir/path2"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_backupdir/initial"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_backupdir-fubehaq6"
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/initdir/test_backupdir-fubehaq6: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/initdir/test_backupdir-fubehaq6: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:37 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:37 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:37 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:37 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_backupdir/modfiles"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_backupdir-jaqesac1"
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/datadir/test_backupdir-jaqesac1: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/datadir/test_backupdir-jaqesac1: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:37 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:37 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:37 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:37 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:37 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:37 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:37 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: list [/rclone-test-jisagow5dego/011836si/backupdir/path1]
2024/11/07 01:18:37 ERROR : : error listing: directory not found
2024/11/07 01:18:37 ERROR : : error listing: directory not found
2024/11/07 01:18:37 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_backupdir-fubehaq6
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: list [/rclone-test-jisagow5dego/011836si/backupdir/path1]
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/RCLONE_TEST]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file1.txt]
2024/11/07 01:18:37 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file2.txt]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file3.txt]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: Waiting for transfers to finish
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file4.txt]
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file5.txt]
2024/11/07 01:18:37 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file6.txt]
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file7.txt]
2024/11/07 01:18:37 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: update [/rclone-test-jisagow5dego/011836si/backupdir/path1/file8.txt]
2024/11/07 01:18:37 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/backupdir/path1: list [/rclone-test-jisagow5dego/011836si/backupdir/path1]
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/backupdir/path2: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/backupdir/path2: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:37 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:37 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:37 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:37 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:37 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: checking path2 Local file system at /tmp/011836si/backupdir/path2
2024/11/07 01:18:37 NOTICE: (01)  : test backupdir
2024/11/07 01:18:37 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:37 NOTICE: (03)  : bisync resync backupdir1=/tmp/011836si/workdir/backupdirs/backupdir1 backupdir2=/tmp/011836si/workdir/backupdirs/backupdir2
    bisync_test.go:923: backupdir test currently only works on local (it uses the workdir)
=== RUN   TestBisyncRemoteLocal/basic
2024/11/07 01:18:37 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:37 DEBUG : path1: Making directory
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:37 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/basic/path1"
2024/11/07 01:18:37 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:37 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:37 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/basic/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/basic/path1"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/basic/path2"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_basic/initial"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_basic-sinobor1"
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:37 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:37 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:37 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/initdir/test_basic-sinobor1: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/initdir/test_basic-sinobor1: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:37 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:37 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:37 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:37 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:37 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:37 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:37 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_basic/modfiles"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_basic-dumedek2"
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/datadir/test_basic-dumedek2: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/datadir/test_basic-dumedek2: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: list [/rclone-test-jisagow5dego/011836si/basic/path1]
2024/11/07 01:18:37 ERROR : : error listing: directory not found
2024/11/07 01:18:37 ERROR : : error listing: directory not found
2024/11/07 01:18:37 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_basic-sinobor1
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: list [/rclone-test-jisagow5dego/011836si/basic/path1]
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/RCLONE_TEST]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/file1.copy2.txt]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/file1.copy1.txt]
2024/11/07 01:18:37 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : subdir: Making directory
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: mkdir [/rclone-test-jisagow5dego/011836si/basic/path1/subdir]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/file1.copy3.txt]
2024/11/07 01:18:37 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: Waiting for transfers to finish
2024/11/07 01:18:37 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/file1.copy4.txt]
2024/11/07 01:18:37 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/file1.copy5.txt]
2024/11/07 01:18:37 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/file1.txt]
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: update [/rclone-test-jisagow5dego/011836si/basic/path1/subdir/file20.txt]
2024/11/07 01:18:37 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: list [/rclone-test-jisagow5dego/011836si/basic/path1]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/basic/path1: list [/rclone-test-jisagow5dego/011836si/basic/path1/subdir]
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:37 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:37 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:37 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:37 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:37 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/basic/path2: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:37 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:37 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/basic/path2: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:37 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:37 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:37 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:37 NOTICE: checking path2 Local file system at /tmp/011836si/basic/path2
2024/11/07 01:18:37 NOTICE: (01)  : test basic
2024/11/07 01:18:37 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:37 NOTICE: (03)  : bisync resync
2024/11/07 01:18:37 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:37 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:37 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:37 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/basic/path1/" with Path2 "/tmp/011836si/basic/path2/"
2024/11/07 01:18:37 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:37 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:37 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:37 INFO  : Resync updating listings
2024/11/07 01:18:37 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/basic/path1/" vs Path2 "/tmp/011836si/basic/path2/"
2024/11/07 01:18:37 INFO  : Bisync successful
2024/11/07 01:18:37 NOTICE: (04)  : test place newer files on both paths
2024/11/07 01:18:37 NOTICE: (05)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_basic-dumedek2/file1.txt /tmp/011836si/basic/path2/
2024/11/07 01:18:37 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:37 NOTICE: (06)  : copy-as /tmp/011836si/datadir/test_basic-dumedek2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/basic/path1/subdir file20.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (replaced existing) to: file20.txt
2024/11/07 01:18:37 NOTICE: (07)  : test bisync run
2024/11/07 01:18:37 NOTICE: (08)  : bisync
2024/11/07 01:18:37 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:37 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:37 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:37 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/basic/path1/" with Path2 "/tmp/011836si/basic/path2/"
2024/11/07 01:18:37 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:37 INFO  : Path1 checking for diffs
2024/11/07 01:18:37 INFO  : - Path1    File changed: size (larger), time (newer) - subdir/file20.txt
2024/11/07 01:18:37 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:37 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:37 INFO  : Path2 checking for diffs
2024/11/07 01:18:37 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:37 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:37 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:37 INFO  : Applying changes
2024/11/07 01:18:37 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/basic/path2/subdir/file20.txt
2024/11/07 01:18:37 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/basic/path1/file1.txt
2024/11/07 01:18:37 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:37 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:37 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:37 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:37 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:37 INFO  : Updating listings
2024/11/07 01:18:37 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/basic/path1/" vs Path2 "/tmp/011836si/basic/path2/"
2024/11/07 01:18:37 INFO  : Bisync successful
    bisync_test.go:558: TEST basic PASSED
=== RUN   TestBisyncRemoteLocal/changes
2024/11/07 01:18:37 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:37 DEBUG : path1: Making directory
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:37 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/changes/path1"
2024/11/07 01:18:37 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:37 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:37 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:37 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:37 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/changes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/changes/path2"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_changes/initial"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_changes-nifitok8"
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/initdir/test_changes-nifitok8: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/initdir/test_changes-nifitok8: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:37 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:37 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:37 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:37 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_changes/modfiles"
2024/11/07 01:18:37 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_changes-jekired4"
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/datadir/test_changes-jekired4: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/datadir/test_changes-jekired4: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:37 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:37 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:37 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:37 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:37 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:37 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:37 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:37 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: list [/rclone-test-jisagow5dego/011836si/changes/path1]
2024/11/07 01:18:37 ERROR : : error listing: directory not found
2024/11/07 01:18:37 ERROR : : error listing: directory not found
2024/11/07 01:18:37 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_changes-nifitok8
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: list [/rclone-test-jisagow5dego/011836si/changes/path1]
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/RCLONE_TEST]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file1.txt]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file2.txt]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file3.txt]
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: Waiting for transfers to finish
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file4.txt]
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file5.txt]
2024/11/07 01:18:37 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file6.txt]
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file7.txt]
2024/11/07 01:18:37 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: update [/rclone-test-jisagow5dego/011836si/changes/path1/file8.txt]
2024/11/07 01:18:37 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1
2024/11/07 01:18:37 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/changes/path1: list [/rclone-test-jisagow5dego/011836si/changes/path1]
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/changes/path2: Waiting for checks to finish
2024/11/07 01:18:37 DEBUG : Local file system at /tmp/011836si/changes/path2: Waiting for transfers to finish
2024/11/07 01:18:37 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:37 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:37 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:37 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:37 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:37 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:37 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:37 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:37 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:37 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:37 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:37 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:37 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: checking path2 Local file system at /tmp/011836si/changes/path2
2024/11/07 01:18:37 NOTICE: (01)  : test changes
2024/11/07 01:18:37 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:37 NOTICE: (03)  : bisync resync
2024/11/07 01:18:37 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:37 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:37 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/" with Path2 "/tmp/011836si/changes/path2/"
2024/11/07 01:18:37 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:37 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:37 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:37 INFO  : Resync updating listings
2024/11/07 01:18:37 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/" vs Path2 "/tmp/011836si/changes/path2/"
2024/11/07 01:18:37 INFO  : Bisync successful
2024/11/07 01:18:37 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:18:37 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:18:37 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/file10.txt /tmp/011836si/changes/path2/
2024/11/07 01:18:37 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: (07)  : test newer on path2 - file1
2024/11/07 01:18:37 NOTICE: (08)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/file1.txt /tmp/011836si/changes/path2/
2024/11/07 01:18:37 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:37 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:18:37 NOTICE: (10)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/
2024/11/07 01:18:37 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:37 NOTICE: (11)  : test newer on path1 - file2
2024/11/07 01:18:37 NOTICE: (12)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/
2024/11/07 01:18:37 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:37 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:18:37 NOTICE: (14)  : delete-file /tmp/011836si/changes/path2/file3.txt
2024/11/07 01:18:37 INFO  : file3.txt: Deleted
2024/11/07 01:18:37 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:18:37 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/file4.txt
2024/11/07 01:18:37 INFO  : file4.txt: Deleted
2024/11/07 01:18:37 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:18:37 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/file8.txt
2024/11/07 01:18:37 INFO  : file8.txt: Deleted
2024/11/07 01:18:37 NOTICE: (19)  : delete-file /tmp/011836si/changes/path2/file8.txt
2024/11/07 01:18:37 INFO  : file8.txt: Deleted
2024/11/07 01:18:37 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:18:37 NOTICE: (21)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/ file5R.txt
2024/11/07 01:18:37 NOTICE: (22)  : copy-as /tmp/011836si/datadir/test_changes-jekired4/file5R.txt /tmp/011836si/changes/path2/ file5.txt
2024/11/07 01:18:37 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:37 NOTICE: (23)  : touch-glob 2001-03-04 /tmp/011836si/datadir/test_changes-jekired4/ file5L.txt
2024/11/07 01:18:37 NOTICE: (24)  : copy-as /tmp/011836si/datadir/test_changes-jekired4/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/ file5.txt
2024/11/07 01:18:37 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:37 NOTICE: (25)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:18:37 NOTICE: (26)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/file6.txt /tmp/011836si/changes/path2/
2024/11/07 01:18:37 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:37 NOTICE: (27)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/file6.txt
2024/11/07 01:18:37 INFO  : file6.txt: Deleted
2024/11/07 01:18:37 NOTICE: (28)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:18:37 NOTICE: (29)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_changes-jekired4/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/changes/path1/
2024/11/07 01:18:37 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:37 NOTICE: (30)  : delete-file /tmp/011836si/changes/path2/file7.txt
2024/11/07 01:18:37 INFO  : file7.txt: Deleted
2024/11/07 01:18:37 NOTICE: (31)  : test bisync run
2024/11/07 01:18:37 NOTICE: (32)  : bisync
2024/11/07 01:18:37 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:37 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:37 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/" with Path2 "/tmp/011836si/changes/path2/"
2024/11/07 01:18:37 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:37 INFO  : Path1 checking for diffs
2024/11/07 01:18:37 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:37 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:37 INFO  : - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:37 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:37 INFO  : - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:18:37 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:18:37 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:37 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:37 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:37 INFO  : Path2 checking for diffs
2024/11/07 01:18:37 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:37 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:37 INFO  : - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:37 INFO  : - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:18:37 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:37 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:18:37 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:37 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:37 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:37 INFO  : Applying changes
2024/11/07 01:18:37 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:37 INFO  : Checking potential conflicts...
2024/11/07 01:18:37 NOTICE: Local file system at /tmp/011836si/changes/path2: 1 differences found
2024/11/07 01:18:37 NOTICE: Local file system at /tmp/011836si/changes/path2: 1 errors while checking
2024/11/07 01:18:37 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:37 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/changes/path2/file11.txt
2024/11/07 01:18:37 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/changes/path2/file2.txt
2024/11/07 01:18:37 INFO  : - Path2    Queue delete              - /tmp/011836si/changes/path2/file4.txt
2024/11/07 01:18:37 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:37 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/file5.txt.conflict1
2024/11/07 01:18:37 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:37 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/changes/path2/file5.txt.conflict1
2024/11/07 01:18:37 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/changes/path2/file5.txt.conflict2
2024/11/07 01:18:37 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:37 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/file5.txt.conflict2
2024/11/07 01:18:37 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/file6.txt
2024/11/07 01:18:37 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/changes/path2/file7.txt
2024/11/07 01:18:37 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/file1.txt
2024/11/07 01:18:37 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/file10.txt
2024/11/07 01:18:37 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/file3.txt
2024/11/07 01:18:37 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:37 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:37 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:37 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:38 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:38 INFO  : file3.txt: Deleted
2024/11/07 01:18:38 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:38 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:38 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:38 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:38 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:38 INFO  : file4.txt: Deleted
2024/11/07 01:18:38 INFO  : Updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/changes/path1/" vs Path2 "/tmp/011836si/changes/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
    bisync_test.go:558: TEST changes PASSED
=== RUN   TestBisyncRemoteLocal/check_access
2024/11/07 01:18:38 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:38 DEBUG : path1: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:38 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/check_access/path1"
2024/11/07 01:18:38 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:38 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:38 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/check_access/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/tmp/011836si/check_access/path2"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access/initial"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_check_access-qanalot7"
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/initdir/test_check_access-qanalot7: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/initdir/test_check_access-qanalot7: Waiting for transfers to finish
2024/11/07 01:18:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:38 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:38 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:38 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:38 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:38 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access/modfiles"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_check_access-jiqobuv2"
2024/11/07 01:18:38 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/datadir/test_check_access-jiqobuv2: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/datadir/test_check_access-jiqobuv2: Waiting for transfers to finish
2024/11/07 01:18:38 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:38 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:38 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: list [/rclone-test-jisagow5dego/011836si/check_access/path1]
2024/11/07 01:18:38 ERROR : : error listing: directory not found
2024/11/07 01:18:38 ERROR : : error listing: directory not found
2024/11/07 01:18:38 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_check_access-qanalot7
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: list [/rclone-test-jisagow5dego/011836si/check_access/path1]
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/file1.txt]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access/path1/subdir]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/file2.txt]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/RCLONE_TEST]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/file3.txt]
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: Waiting for transfers to finish
2024/11/07 01:18:38 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/file4.txt]
2024/11/07 01:18:38 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/subdir/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: update [/rclone-test-jisagow5dego/011836si/check_access/path1/subdir/file20.txt]
2024/11/07 01:18:38 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:38 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: list [/rclone-test-jisagow5dego/011836si/check_access/path1]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access/path1: list [/rclone-test-jisagow5dego/011836si/check_access/path1/subdir]
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:38 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:38 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:38 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:38 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:38 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/check_access/path2: Waiting for checks to finish
2024/11/07 01:18:38 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/check_access/path2: Waiting for transfers to finish
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 NOTICE: checking path2 Local file system at /tmp/011836si/check_access/path2
2024/11/07 01:18:38 NOTICE: (01)  : test check-access
2024/11/07 01:18:38 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:38 NOTICE: (03)  : bisync resync
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:38 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:38 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:38 INFO  : Resync updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" vs Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
2024/11/07 01:18:38 NOTICE: (04)  : test 1. see that check-access passes with the initial setup
2024/11/07 01:18:38 NOTICE: (05)  : bisync check-access
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:38 INFO  : Path1 checking for diffs
2024/11/07 01:18:38 INFO  : Path2 checking for diffs
2024/11/07 01:18:38 INFO  : Checking access health
2024/11/07 01:18:38 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:38 INFO  : No changes found
2024/11/07 01:18:38 INFO  : Updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" vs Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
2024/11/07 01:18:38 NOTICE: (06)  : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical.
2024/11/07 01:18:38 NOTICE: (07)  : delete-file /tmp/011836si/check_access/path2/subdir/RCLONE_TEST
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:38 NOTICE: (08)  : bisync check-access
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:38 INFO  : Path1 checking for diffs
2024/11/07 01:18:38 INFO  : Path2 checking for diffs
2024/11/07 01:18:38 INFO  : - Path2    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:18:38 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:38 INFO  : Checking access health
2024/11/07 01:18:38 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST
2024/11/07 01:18:38 ERROR : -          Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST
2024/11/07 01:18:38 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:38 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:38 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:38 NOTICE: (09)  : copy-listings path2-missing
2024/11/07 01:18:38 NOTICE: (10)  : test 3. put the path2 subdir RCLONE_TEST back, resync.
2024/11/07 01:18:38 NOTICE: (11)  : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access/path1/subdir/RCLONE_TEST /tmp/011836si/check_access/path2/
2024/11/07 01:18:38 NOTICE: (12)  : bisync resync
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:38 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:38 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Resync updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" vs Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
2024/11/07 01:18:38 NOTICE: (13)  : test 4. run sync with check-access. should pass.
2024/11/07 01:18:38 NOTICE: (14)  : bisync check-access
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:38 INFO  : Path1 checking for diffs
2024/11/07 01:18:38 INFO  : Path2 checking for diffs
2024/11/07 01:18:38 INFO  : Checking access health
2024/11/07 01:18:38 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:38 INFO  : No changes found
2024/11/07 01:18:38 INFO  : Updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" vs Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
2024/11/07 01:18:38 NOTICE: (15)  : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical.
2024/11/07 01:18:38 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access/path1/RCLONE_TEST
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:38 NOTICE: (17)  : bisync check-access
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:38 INFO  : Path1 checking for diffs
2024/11/07 01:18:38 INFO  : - Path1    File was deleted          - RCLONE_TEST
2024/11/07 01:18:38 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:38 INFO  : Path2 checking for diffs
2024/11/07 01:18:38 INFO  : Checking access health
2024/11/07 01:18:38 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST
2024/11/07 01:18:38 ERROR : -          Access test failed: Path2 file not found in Path1 - RCLONE_TEST
2024/11/07 01:18:38 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:38 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:38 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:38 NOTICE: (18)  : copy-listings path1-missing
2024/11/07 01:18:38 NOTICE: (19)  : test 6. run again. should fail critical due to missing listings.
2024/11/07 01:18:38 NOTICE: (20)  : bisync check-access
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_check_access_path1..tmp_011836si_check_access_path2.path1.lst
Path2: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_check_access_path1..tmp_011836si_check_access_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011836si/workdir"
2024/11/07 01:18:38 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:38 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:38 NOTICE: (21)  : move-listings missing-listings
2024/11/07 01:18:38 NOTICE: (22)  : test 7. run resync, which will copy the path2 top level back to path1.
2024/11/07 01:18:38 NOTICE: (23)  : bisync resync
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:38 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:38 INFO  : Resync updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" vs Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
2024/11/07 01:18:38 NOTICE: (24)  : test 8. run sync with --check-access. should pass.
2024/11/07 01:18:38 NOTICE: (25)  : bisync check-access
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:38 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:38 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" with Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:38 INFO  : Path1 checking for diffs
2024/11/07 01:18:38 INFO  : Path2 checking for diffs
2024/11/07 01:18:38 INFO  : Checking access health
2024/11/07 01:18:38 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:38 INFO  : No changes found
2024/11/07 01:18:38 INFO  : Updating listings
2024/11/07 01:18:38 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access/path1/" vs Path2 "/tmp/011836si/check_access/path2/"
2024/11/07 01:18:38 INFO  : Bisync successful
    bisync_test.go:558: TEST check_access PASSED
=== RUN   TestBisyncRemoteLocal/check_access_filters
2024/11/07 01:18:38 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:38 DEBUG : path1: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:38 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/check_access_filters/path1"
2024/11/07 01:18:38 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:38 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:38 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:38 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:38 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/check_access_filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/tmp/011836si/check_access_filters/path2"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_check_access_filters-lokofon0"
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:38 DEBUG : subdir-not: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not
2024/11/07 01:18:38 DEBUG : subdirX: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdirX", newDst=subdirX
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1
2024/11/07 01:18:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2: Making directory with metadata
2024/11/07 01:18:38 DEBUG : subdir/subdirA: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2
2024/11/07 01:18:38 INFO  : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirB: Making directory with metadata
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 INFO  : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB
2024/11/07 01:18:38 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:38 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:38 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/initdir/test_check_access_filters-lokofon0: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt.5028a97.partial: renamed to: subdirX/file20.txt
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/initdir/test_check_access_filters-lokofon0: Waiting for transfers to finish
2024/11/07 01:18:38 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:38 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/RCLONE_TEST
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:38 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:38 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt.5028a97.partial: renamed to: subdir-not/file20.txt
2024/11/07 01:18:38 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt.5028a97.partial: renamed to: subdirX/subdirX1/file30.txt
2024/11/07 01:18:38 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt.5028a97.partial: renamed to: subdir-not/subdir-not2/file30.txt
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt.5028a97.partial: renamed to: subdir/subdirB/file30.txt
2024/11/07 01:18:38 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt.5028a97.partial: renamed to: subdir/subdirA/file30.txt
2024/11/07 01:18:38 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirB/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/modfiles"
2024/11/07 01:18:38 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_check_access_filters-qoxomaj0"
2024/11/07 01:18:38 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/datadir/test_check_access_filters-qoxomaj0: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/datadir/test_check_access_filters-qoxomaj0: Waiting for transfers to finish
2024/11/07 01:18:38 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK
2024/11/07 01:18:38 DEBUG : exclude-other-filtersfile.txt.9180e6d6.partial: renamed to: exclude-other-filtersfile.txt
2024/11/07 01:18:38 INFO  : exclude-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK
2024/11/07 01:18:38 DEBUG : include-other-filtersfile.txt.5fb1cd78.partial: renamed to: include-other-filtersfile.txt
2024/11/07 01:18:38 INFO  : include-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1]
2024/11/07 01:18:38 ERROR : : error listing: directory not found
2024/11/07 01:18:38 ERROR : : error listing: directory not found
2024/11/07 01:18:38 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_check_access_filters-lokofon0
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1]
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/RCLONE_TEST]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/file1.txt]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/file2.txt]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/file3.txt]
2024/11/07 01:18:38 DEBUG : subdir-not: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not]
2024/11/07 01:18:38 DEBUG : subdirX: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX]
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/subdirX1]
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirA: Making directory
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirA]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/subdir-not2]
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirB: Making directory
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirB]
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/file4.txt]
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: Waiting for transfers to finish
2024/11/07 01:18:38 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/file20.txt]
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/file20.txt]
2024/11/07 01:18:38 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/file20.txt]
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/subdirX1/file30.txt]
2024/11/07 01:18:38 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/subdir-not2/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/subdir-not2/file30.txt]
2024/11/07 01:18:38 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirB/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirB/file30.txt]
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirA/RCLONE_TEST]
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: update [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirA/file30.txt]
2024/11/07 01:18:38 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:18:38 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/subdir-not2]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/subdirX1]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirB]
2024/11/07 01:18:38 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_access_filters/path1: list [/rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/subdirA]
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:38 DEBUG : subdir-not: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not
2024/11/07 01:18:38 DEBUG : subdirX: Making directory with metadata
2024/11/07 01:18:38 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:38 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:38 INFO  : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdirX", newDst=subdirX
2024/11/07 01:18:38 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:38 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1: Making directory with metadata
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2: Making directory with metadata
2024/11/07 01:18:38 INFO  : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirA: Making directory with metadata
2024/11/07 01:18:38 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 INFO  : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA
2024/11/07 01:18:38 DEBUG : subdir/subdirB: Making directory with metadata
2024/11/07 01:18:38 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:38 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:38 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:38 DEBUG : subdirX/file20.txt.5028a97.partial: renamed to: subdirX/file20.txt
2024/11/07 01:18:38 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/check_access_filters/path2: Waiting for checks to finish
2024/11/07 01:18:38 DEBUG : Local file system at /tmp/011836si/check_access_filters/path2: Waiting for transfers to finish
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir-not/file20.txt.5028a97.partial: renamed to: subdir-not/file20.txt
2024/11/07 01:18:38 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/file30.txt.5028a97.partial: renamed to: subdirX/subdirX1/file30.txt
2024/11/07 01:18:38 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:38 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir-not/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdirX/subdirX1/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/file30.txt.5028a97.partial: renamed to: subdir-not/subdir-not2/file30.txt
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/subdirB/file30.txt.5028a97.partial: renamed to: subdir/subdirB/file30.txt
2024/11/07 01:18:38 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:38 DEBUG : subdir/subdirA/file30.txt.5028a97.partial: renamed to: subdir/subdirA/file30.txt
2024/11/07 01:18:38 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/subdirB/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirB/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:38 DEBUG : subdir/subdirA/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:38 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:38 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:38 NOTICE: checking path2 Local file system at /tmp/011836si/check_access_filters/path2
2024/11/07 01:18:38 NOTICE: (01)  : test check-access-filters
2024/11/07 01:18:38 NOTICE: (02)  : test EXCLUDE - OTHER TESTS
2024/11/07 01:18:38 NOTICE: (03)  : copy-file /tmp/011836si/datadir/test_check_access_filters-qoxomaj0/exclude-other-filtersfile.txt /tmp/011836si/workdir/
2024/11/07 01:18:38 INFO  : exclude-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:38 NOTICE: (04)  : test resync to get the filters file md5 built.
2024/11/07 01:18:38 NOTICE: (05)  : bisync resync filters-file=/tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Storing filters file hash to /tmp/011836si/workdir/exclude-other-filtersfile.txt.md5
2024/11/07 01:18:39 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:39 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:39 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:39 INFO  : Resync updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" vs Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (06)  : test EXCLUDE - test filters for check access
2024/11/07 01:18:39 NOTICE: (07)  : bisync check-access filters-file=/tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 3 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:39 INFO  : No changes found
2024/11/07 01:18:39 INFO  : Updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" vs Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (08)  : copy-listings exclude-initial
2024/11/07 01:18:39 NOTICE: (09)  : test EXCLUDE - delete RCLONE_TEST files in excluded directories
2024/11/07 01:18:39 NOTICE: (10)  : delete-file /tmp/011836si/check_access_filters/path2/subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (11)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (12)  : delete-file /tmp/011836si/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (13)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (14)  : test EXCLUDE - test should PASS
2024/11/07 01:18:39 NOTICE: (15)  : bisync check-access filters-file=/tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 3 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:39 INFO  : No changes found
2024/11/07 01:18:39 INFO  : Updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" vs Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (16)  : copy-listings exclude-pass-run
2024/11/07 01:18:39 NOTICE: (17)  : test EXCLUDE - delete RCLONE_TEST files in included directories
2024/11/07 01:18:39 NOTICE: (18)  : delete-file /tmp/011836si/check_access_filters/path2/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (20)  : test EXCLUDE - test should ABORT
2024/11/07 01:18:39 NOTICE: (21)  : bisync check-access filters-file=/tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : - Path1    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:18:39 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : - Path2    File was deleted          - RCLONE_TEST
2024/11/07 01:18:39 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 ERROR : -          Access test failed: Path1 file not found in Path2 - RCLONE_TEST
2024/11/07 01:18:39 ERROR : -          Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST
2024/11/07 01:18:39 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:39 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:39 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:39 NOTICE: (22)  : move-listings exclude-error-run
2024/11/07 01:18:39 NOTICE: (23)  : test INCLUDE - OTHER TESTS
2024/11/07 01:18:39 NOTICE: (24)  : test reset to the initial state
2024/11/07 01:18:39 NOTICE: (25)  : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/
2024/11/07 01:18:39 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 NOTICE: (26)  : sync-dir TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/ /tmp/011836si/check_access_filters/path2/
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 NOTICE: (27)  : copy-file /tmp/011836si/datadir/test_check_access_filters-qoxomaj0/include-other-filtersfile.txt /tmp/011836si/workdir/
2024/11/07 01:18:39 INFO  : include-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:39 NOTICE: (28)  : bisync resync filters-file=/tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Storing filters file hash to /tmp/011836si/workdir/include-other-filtersfile.txt.md5
2024/11/07 01:18:39 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:39 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:39 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:39 INFO  : Resync updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" vs Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (29)  : test INCLUDE - test include/exclude filters for check access
2024/11/07 01:18:39 NOTICE: (30)  : bisync check-access filters-file=/tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 5 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:39 INFO  : No changes found
2024/11/07 01:18:39 INFO  : Updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" vs Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (31)  : copy-listings include-initial
2024/11/07 01:18:39 NOTICE: (32)  : test INCLUDE - delete RCLONE_TEST files in excluded directories
2024/11/07 01:18:39 NOTICE: (33)  : delete-file /tmp/011836si/check_access_filters/path2/subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (34)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir-not/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (35)  : delete-file /tmp/011836si/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (36)  : test INCLUDE - test should PASS
2024/11/07 01:18:39 NOTICE: (37)  : bisync check-access filters-file=/tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 5 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:39 INFO  : No changes found
2024/11/07 01:18:39 INFO  : Updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" vs Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (38)  : copy-listings include-pass-run
2024/11/07 01:18:39 NOTICE: (39)  : test INCLUDE - delete RCLONE_TEST files in included directories
2024/11/07 01:18:39 NOTICE: (40)  : delete-file /tmp/011836si/check_access_filters/path2/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (41)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdir/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (42)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:39 NOTICE: (43)  : test INCLUDE - test should ABORT
2024/11/07 01:18:39 NOTICE: (44)  : bisync check-access filters-file=/tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_access_filters/path1/" with Path2 "/tmp/011836si/check_access_filters/path2/"
2024/11/07 01:18:39 INFO  : Using filters file /tmp/011836si/workdir/include-other-filtersfile.txt
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : - Path1    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:18:39 INFO  : - Path1    File was deleted          - subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:39 INFO  : Path1:    2 changes:    0 new,    0 modified,    2 deleted
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : - Path2    File was deleted          - RCLONE_TEST
2024/11/07 01:18:39 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST
2024/11/07 01:18:39 ERROR : -          Access test failed: Path1 file not found in Path2 - RCLONE_TEST
2024/11/07 01:18:39 ERROR : -          Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:39 ERROR : -          Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST
2024/11/07 01:18:39 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:39 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:39 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:39 NOTICE: (45)  : move-listings include-error-run
    bisync_test.go:558: TEST check_access_filters PASSED
=== RUN   TestBisyncRemoteLocal/check_filename
2024/11/07 01:18:39 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:39 DEBUG : path1: Making directory
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:39 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/check_filename/path1"
2024/11/07 01:18:39 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:39 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:39 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:39 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:39 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:39 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:39 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/check_filename/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/tmp/011836si/check_filename/path2"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/initial"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_check_filename-yafuqux0"
2024/11/07 01:18:39 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:39 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:39 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:39 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/initdir/test_check_filename-yafuqux0: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/initdir/test_check_filename-yafuqux0: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:39 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:39 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:39 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:39 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:39 DEBUG : .chk_file.cf9a93ac.partial: renamed to: .chk_file
2024/11/07 01:18:39 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:39 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:39 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:39 DEBUG : subdir/.chk_file.cf9a93ac.partial: renamed to: subdir/.chk_file
2024/11/07 01:18:39 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/modfiles"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_check_filename-vuluvuv4"
2024/11/07 01:18:39 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/datadir/test_check_filename-vuluvuv4: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/datadir/test_check_filename-vuluvuv4: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:39 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:39 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: list [/rclone-test-jisagow5dego/011836si/check_filename/path1]
2024/11/07 01:18:39 ERROR : : error listing: directory not found
2024/11/07 01:18:39 ERROR : : error listing: directory not found
2024/11/07 01:18:39 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_check_filename-yafuqux0
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: list [/rclone-test-jisagow5dego/011836si/check_filename/path1]
2024/11/07 01:18:39 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : subdir: Making directory
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: mkdir [/rclone-test-jisagow5dego/011836si/check_filename/path1/subdir]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/.chk_file]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/file1.txt]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/file2.txt]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/file3.txt]
2024/11/07 01:18:39 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: Waiting for transfers to finish
2024/11/07 01:18:39 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/file4.txt]
2024/11/07 01:18:39 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/subdir/.chk_file]
2024/11/07 01:18:39 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: update [/rclone-test-jisagow5dego/011836si/check_filename/path1/subdir/file20.txt]
2024/11/07 01:18:39 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:39 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:39 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:18:39 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:39 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: list [/rclone-test-jisagow5dego/011836si/check_filename/path1]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_filename/path1: list [/rclone-test-jisagow5dego/011836si/check_filename/path1/subdir]
2024/11/07 01:18:39 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:39 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:39 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:39 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/check_filename/path2: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/check_filename/path2: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:39 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:39 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:39 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:39 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:39 DEBUG : .chk_file.cf9a93ac.partial: renamed to: .chk_file
2024/11/07 01:18:39 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:39 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:39 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:39 DEBUG : subdir/.chk_file.cf9a93ac.partial: renamed to: subdir/.chk_file
2024/11/07 01:18:39 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 NOTICE: checking path2 Local file system at /tmp/011836si/check_filename/path2
2024/11/07 01:18:39 NOTICE: (01)  : test check-filename
2024/11/07 01:18:39 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:39 NOTICE: (03)  : bisync resync
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" with Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:39 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:39 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:39 INFO  : Resync updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" vs Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (04)  : test 1. see that check-access passes with the initial setup
2024/11/07 01:18:39 NOTICE: (05)  : bisync check-access check-filename=.chk_file
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" with Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:18:39 INFO  : No changes found
2024/11/07 01:18:39 INFO  : Updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" vs Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (06)  : copy-listings initial-pass
2024/11/07 01:18:39 NOTICE: (07)  : test 2. delete the remote subdir .chk_file, run sync. should fail critical.
2024/11/07 01:18:39 NOTICE: (08)  : delete-file /tmp/011836si/check_filename/path2/subdir/.chk_file
2024/11/07 01:18:39 INFO  : .chk_file: Deleted
2024/11/07 01:18:39 NOTICE: (09)  : bisync check-access check-filename=.chk_file
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" with Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : - Path2    File was deleted          - subdir/.chk_file
2024/11/07 01:18:39 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file
2024/11/07 01:18:39 ERROR : -          Access test failed: Path1 file not found in Path2 - subdir/.chk_file
2024/11/07 01:18:39 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:39 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:39 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:39 NOTICE: (10)  : move-listings path2-missing
2024/11/07 01:18:39 NOTICE: (11)  : test 3. put the remote subdir .chk_file back, run resync.
2024/11/07 01:18:39 NOTICE: (12)  : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/check_filename/path1/subdir/.chk_file /tmp/011836si/check_filename/path2/subdir/
2024/11/07 01:18:39 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:39 NOTICE: (13)  : bisync check-access resync check-filename=.chk_file
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" with Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:18:39 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:39 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:39 INFO  : Resync updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" vs Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (14)  : test 4. run sync with check-access. should pass.
2024/11/07 01:18:39 NOTICE: (15)  : bisync check-access check-filename=.chk_file
2024/11/07 01:18:39 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" with Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:39 INFO  : Path1 checking for diffs
2024/11/07 01:18:39 INFO  : Path2 checking for diffs
2024/11/07 01:18:39 INFO  : Checking access health
2024/11/07 01:18:39 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:18:39 INFO  : No changes found
2024/11/07 01:18:39 INFO  : Updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_filename/path1/" vs Path2 "/tmp/011836si/check_filename/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
    bisync_test.go:558: TEST check_filename PASSED
=== RUN   TestBisyncRemoteLocal/check_sync
2024/11/07 01:18:39 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:39 DEBUG : path1: Making directory
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:39 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/check_sync/path1"
2024/11/07 01:18:39 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:39 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:39 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:39 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:39 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:39 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:39 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/check_sync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/tmp/011836si/check_sync/path2"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_sync/initial"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_check_sync-riqexul7"
2024/11/07 01:18:39 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/initdir/test_check_sync-riqexul7: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/initdir/test_check_sync-riqexul7: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:39 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:39 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:39 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:39 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:39 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:39 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:39 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:39 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:39 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_sync/modfiles"
2024/11/07 01:18:39 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_check_sync-kuyusul4"
2024/11/07 01:18:39 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/datadir/test_check_sync-kuyusul4: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/datadir/test_check_sync-kuyusul4: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK
2024/11/07 01:18:39 DEBUG : _testdir_path1.._testdir_path2.path1.lst.c670fe74.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst
2024/11/07 01:18:39 INFO  : _testdir_path1.._testdir_path2.path1.lst: Copied (new)
2024/11/07 01:18:39 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK
2024/11/07 01:18:39 DEBUG : _testdir_path1.._testdir_path2.path2.lst.c670fe74.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst
2024/11/07 01:18:39 INFO  : _testdir_path1.._testdir_path2.path2.lst: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: list [/rclone-test-jisagow5dego/011836si/check_sync/path1]
2024/11/07 01:18:39 ERROR : : error listing: directory not found
2024/11/07 01:18:39 ERROR : : error listing: directory not found
2024/11/07 01:18:39 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_check_sync-riqexul7
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: list [/rclone-test-jisagow5dego/011836si/check_sync/path1]
2024/11/07 01:18:39 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/RCLONE_TEST]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file1.txt]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file2.txt]
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file3.txt]
2024/11/07 01:18:39 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file4.txt]
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file5.txt]
2024/11/07 01:18:39 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file6.txt]
2024/11/07 01:18:39 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file7.txt]
2024/11/07 01:18:39 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: update [/rclone-test-jisagow5dego/011836si/check_sync/path1/file8.txt]
2024/11/07 01:18:39 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:39 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1
2024/11/07 01:18:39 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/check_sync/path1: list [/rclone-test-jisagow5dego/011836si/check_sync/path1]
2024/11/07 01:18:39 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/check_sync/path2: Waiting for checks to finish
2024/11/07 01:18:39 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : Local file system at /tmp/011836si/check_sync/path2: Waiting for transfers to finish
2024/11/07 01:18:39 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:39 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:39 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:39 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:39 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:39 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:39 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:39 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:39 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:39 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:39 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:39 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:39 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:39 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:39 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:39 NOTICE: checking path2 Local file system at /tmp/011836si/check_sync/path2
2024/11/07 01:18:39 NOTICE: (01)  : test check-sync
2024/11/07 01:18:39 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:39 NOTICE: (03)  : bisync resync
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" with Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:39 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:39 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:39 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:39 INFO  : Resync updating listings
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" vs Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (04)  : test 1. run check-sync-only on a clean sync
2024/11/07 01:18:39 NOTICE: (05)  : bisync check-sync-only
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" vs Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:39 INFO  : Bisync successful
2024/11/07 01:18:39 NOTICE: (06)  : test 2. inject modified listings into the workdir
2024/11/07 01:18:39 NOTICE: (07)  : copy-as /tmp/011836si/datadir/test_check_sync-kuyusul4/_testdir_path1.._testdir_path2.path1.lst /tmp/011836si/workdir/ TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path1.lst
2024/11/07 01:18:39 INFO  : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path1.lst
2024/11/07 01:18:39 NOTICE: (08)  : copy-as /tmp/011836si/datadir/test_check_sync-kuyusul4/_testdir_path1.._testdir_path2.path2.lst /tmp/011836si/workdir/ TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path2.lst
2024/11/07 01:18:39 INFO  : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path2.lst
2024/11/07 01:18:39 NOTICE: (09)  : test 3. run check-sync-only on modified listings
2024/11/07 01:18:39 NOTICE: (10)  : bisync check-sync-only
2024/11/07 01:18:39 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:39 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:39 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" vs Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:39 ERROR : -          Path1 file not found in Path2      - file2.txt
2024/11/07 01:18:39 ERROR : -          Path2 file not found in Path1      - file1.txt
2024/11/07 01:18:39 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover
2024/11/07 01:18:39 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:39 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:39 NOTICE: (11)  : copy-listings check-sync-only
2024/11/07 01:18:39 NOTICE: (12)  : test 4. run normal sync to check that it aborts
2024/11/07 01:18:39 NOTICE: (13)  : bisync
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" with Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:40 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path1.lst
Path2: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011836si/workdir"
2024/11/07 01:18:40 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:40 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:40 NOTICE: (14)  : test 5. prune failure listings after critical abort
2024/11/07 01:18:40 NOTICE: (15)  : delete-glob /tmp/011836si/workdir/ *.lst
2024/11/07 01:18:40 NOTICE: (16)  : delete-glob /tmp/011836si/workdir/ *.lst-err
2024/11/07 01:18:40 INFO  : TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path1.lst-err: Deleted
2024/11/07 01:18:40 INFO  : TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path2.lst-err: Deleted
2024/11/07 01:18:40 NOTICE: (17)  : delete-glob /tmp/011836si/workdir/ *.lst-new
2024/11/07 01:18:40 INFO  : TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path1.lst-new: Deleted
2024/11/07 01:18:40 INFO  : TestHdfs_rclone-test-jisagow5dego_011836si_check_sync_path1..tmp_011836si_check_sync_path2.path2.lst-new: Deleted
2024/11/07 01:18:40 NOTICE: (18)  : test 6. run resync
2024/11/07 01:18:40 NOTICE: (19)  : bisync resync
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" with Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:40 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:40 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:40 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:40 INFO  : Resync updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" vs Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (20)  : test 7. run normal sync with check-sync enabled (default)
2024/11/07 01:18:40 NOTICE: (21)  : bisync
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" with Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : No changes found
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" vs Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (22)  : test 8. run normal sync with no-check-sync
2024/11/07 01:18:40 NOTICE: (23)  : bisync no-check-sync
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/check_sync/path1/" with Path2 "/tmp/011836si/check_sync/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : No changes found
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Bisync successful
    bisync_test.go:558: TEST check_sync PASSED
=== RUN   TestBisyncRemoteLocal/compare_all
2024/11/07 01:18:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:40 DEBUG : path1: Making directory
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/compare_all/path1"
2024/11/07 01:18:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/compare_all/path2"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/initial"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_compare_all-qecoqob4"
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/initdir/test_compare_all-qecoqob4: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/initdir/test_compare_all-qecoqob4: Waiting for transfers to finish
2024/11/07 01:18:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:40 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:40 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:40 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:40 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:40 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:40 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:40 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:40 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:40 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_compare_all/modfiles"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_compare_all-fodibak0"
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/datadir/test_compare_all-fodibak0: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/datadir/test_compare_all-fodibak0: Waiting for transfers to finish
2024/11/07 01:18:40 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:40 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:40 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:40 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:40 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:40 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:40 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:40 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:40 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:40 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:40 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:40 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:40 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:40 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:40 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:40 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: list [/rclone-test-jisagow5dego/011836si/compare_all/path1]
2024/11/07 01:18:40 ERROR : : error listing: directory not found
2024/11/07 01:18:40 ERROR : : error listing: directory not found
2024/11/07 01:18:40 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_compare_all-qecoqob4
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: list [/rclone-test-jisagow5dego/011836si/compare_all/path1]
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/RCLONE_TEST]
2024/11/07 01:18:40 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file1.txt]
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file2.txt]
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file3.txt]
2024/11/07 01:18:40 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: Waiting for transfers to finish
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file4.txt]
2024/11/07 01:18:40 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file5.txt]
2024/11/07 01:18:40 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file6.txt]
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file7.txt]
2024/11/07 01:18:40 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: update [/rclone-test-jisagow5dego/011836si/compare_all/path1/file8.txt]
2024/11/07 01:18:40 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:40 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/compare_all/path1: list [/rclone-test-jisagow5dego/011836si/compare_all/path1]
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/compare_all/path2: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/compare_all/path2: Waiting for transfers to finish
2024/11/07 01:18:40 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:40 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:40 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:40 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:40 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:40 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:40 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:40 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:40 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:40 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:40 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:40 NOTICE: checking path2 Local file system at /tmp/011836si/compare_all/path2
2024/11/07 01:18:40 NOTICE: (01)  : test changes compare-all
2024/11/07 01:18:40 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:40 NOTICE: (03)  : bisync resync compare-all
2024/11/07 01:18:40 NOTICE: Local file system at /tmp/011836si/compare_all/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/" with Path2 "/tmp/011836si/compare_all/path2/"
2024/11/07 01:18:40 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:40 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:40 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:40 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:40 INFO  : Resync updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/" vs Path2 "/tmp/011836si/compare_all/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:18:40 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:18:40 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/file10.txt /tmp/011836si/compare_all/path2/
2024/11/07 01:18:40 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:40 NOTICE: (07)  : test newer on path2 - file1
2024/11/07 01:18:40 NOTICE: (08)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/file1.txt /tmp/011836si/compare_all/path2/
2024/11/07 01:18:40 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:40 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:18:40 NOTICE: (10)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/
2024/11/07 01:18:40 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:40 NOTICE: (11)  : test newer on path1 - file2
2024/11/07 01:18:40 NOTICE: (12)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/
2024/11/07 01:18:40 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:40 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:18:40 NOTICE: (14)  : delete-file /tmp/011836si/compare_all/path2/file3.txt
2024/11/07 01:18:40 INFO  : file3.txt: Deleted
2024/11/07 01:18:40 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:18:40 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/file4.txt
2024/11/07 01:18:40 INFO  : file4.txt: Deleted
2024/11/07 01:18:40 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:18:40 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/file8.txt
2024/11/07 01:18:40 INFO  : file8.txt: Deleted
2024/11/07 01:18:40 NOTICE: (19)  : delete-file /tmp/011836si/compare_all/path2/file8.txt
2024/11/07 01:18:40 INFO  : file8.txt: Deleted
2024/11/07 01:18:40 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:18:40 NOTICE: (21)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/ file5R.txt
2024/11/07 01:18:40 NOTICE: (22)  : copy-as /tmp/011836si/datadir/test_compare_all-fodibak0/file5R.txt /tmp/011836si/compare_all/path2/ file5.txt
2024/11/07 01:18:40 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:40 NOTICE: (23)  : touch-glob 2001-03-04 /tmp/011836si/datadir/test_compare_all-fodibak0/ file5L.txt
2024/11/07 01:18:40 NOTICE: (24)  : copy-as /tmp/011836si/datadir/test_compare_all-fodibak0/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/ file5.txt
2024/11/07 01:18:40 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:40 NOTICE: (25)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:18:40 NOTICE: (26)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/file6.txt /tmp/011836si/compare_all/path2/
2024/11/07 01:18:40 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:40 NOTICE: (27)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/file6.txt
2024/11/07 01:18:40 INFO  : file6.txt: Deleted
2024/11/07 01:18:40 NOTICE: (28)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:18:40 NOTICE: (29)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_compare_all-fodibak0/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/compare_all/path1/
2024/11/07 01:18:40 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:40 NOTICE: (30)  : delete-file /tmp/011836si/compare_all/path2/file7.txt
2024/11/07 01:18:40 INFO  : file7.txt: Deleted
2024/11/07 01:18:40 NOTICE: (31)  : test bisync run
2024/11/07 01:18:40 NOTICE: (32)  : bisync compare-all
2024/11/07 01:18:40 NOTICE: Local file system at /tmp/011836si/compare_all/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/" with Path2 "/tmp/011836si/compare_all/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : - Path1    File changed: size (larger), time (newer), hash - file2.txt
2024/11/07 01:18:40 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:40 INFO  : - Path1    File changed: size (larger), time (newer), hash - file5.txt
2024/11/07 01:18:40 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:40 INFO  : - Path1    File changed: size (larger), time (newer), hash - file7.txt
2024/11/07 01:18:40 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:18:40 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:40 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:40 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : - Path2    File changed: size (larger), time (newer), hash - file1.txt
2024/11/07 01:18:40 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:40 INFO  : - Path2    File changed: size (larger), time (newer), hash - file5.txt
2024/11/07 01:18:40 INFO  : - Path2    File changed: size (larger), time (newer), hash - file6.txt
2024/11/07 01:18:40 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:40 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:18:40 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:40 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:40 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:40 INFO  : Applying changes
2024/11/07 01:18:40 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/compare_all/path2/file11.txt
2024/11/07 01:18:40 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/compare_all/path2/file2.txt
2024/11/07 01:18:40 INFO  : - Path2    Queue delete              - /tmp/011836si/compare_all/path2/file4.txt
2024/11/07 01:18:40 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:40 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/file5.txt.conflict1
2024/11/07 01:18:40 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:40 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/compare_all/path2/file5.txt.conflict1
2024/11/07 01:18:40 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/compare_all/path2/file5.txt.conflict2
2024/11/07 01:18:40 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:40 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/file5.txt.conflict2
2024/11/07 01:18:40 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/file6.txt
2024/11/07 01:18:40 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/compare_all/path2/file7.txt
2024/11/07 01:18:40 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/file1.txt
2024/11/07 01:18:40 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/file10.txt
2024/11/07 01:18:40 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/file3.txt
2024/11/07 01:18:40 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:40 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:40 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file3.txt: Deleted
2024/11/07 01:18:40 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:40 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:40 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file4.txt: Deleted
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/compare_all/path1/" vs Path2 "/tmp/011836si/compare_all/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
    bisync_test.go:558: TEST compare_all PASSED
=== RUN   TestBisyncRemoteLocal/createemptysrcdirs
2024/11/07 01:18:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:40 DEBUG : path1: Making directory
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1"
2024/11/07 01:18:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/createemptysrcdirs/path2"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/initial"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_createemptysrcdirs-tarifuf4"
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/initdir/test_createemptysrcdirs-tarifuf4: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/initdir/test_createemptysrcdirs-tarifuf4: Waiting for transfers to finish
2024/11/07 01:18:40 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:40 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:40 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:40 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:40 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:40 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_createemptysrcdirs/modfiles"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_createemptysrcdirs-vasisop0"
2024/11/07 01:18:40 DEBUG : placeholder.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0: Waiting for transfers to finish
2024/11/07 01:18:40 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : placeholder.txt.4db661ca.partial: renamed to: placeholder.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: list [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1]
2024/11/07 01:18:40 ERROR : : error listing: directory not found
2024/11/07 01:18:40 ERROR : : error listing: directory not found
2024/11/07 01:18:40 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_createemptysrcdirs-tarifuf4
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: list [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1]
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/file1.copy1.txt]
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/file1.copy2.txt]
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/file1.copy3.txt]
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/RCLONE_TEST]
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: Waiting for transfers to finish
2024/11/07 01:18:40 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/file1.copy4.txt]
2024/11/07 01:18:40 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/file1.copy5.txt]
2024/11/07 01:18:40 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: update [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/file1.txt]
2024/11/07 01:18:40 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:40 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1: list [/rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1]
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/createemptysrcdirs/path2: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/createemptysrcdirs/path2: Waiting for transfers to finish
2024/11/07 01:18:40 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:40 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:40 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:40 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:40 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:40 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:40 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:40 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:40 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:40 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:40 NOTICE: checking path2 Local file system at /tmp/011836si/createemptysrcdirs/path2
2024/11/07 01:18:40 NOTICE: (01)  : test createemptysrcdirs
2024/11/07 01:18:40 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:40 NOTICE: (03)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/ placeholder.txt
2024/11/07 01:18:40 NOTICE: (04)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:40 NOTICE: (05)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt
2024/11/07 01:18:40 NOTICE: (06)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt
2024/11/07 01:18:40 NOTICE: (07)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt
2024/11/07 01:18:40 NOTICE: (08)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt
2024/11/07 01:18:40 NOTICE: (09)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt
2024/11/07 01:18:40 NOTICE: (10)  : bisync resync
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:40 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:40 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:40 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:18:40 INFO  : Resync updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (11)  : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder
2024/11/07 01:18:40 NOTICE: (12)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ subdir/placeholder.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: subdir/placeholder.txt
2024/11/07 01:18:40 NOTICE: (13)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ subdir
2024/11/07 01:18:40 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/subdir/placeholder.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Deleted
2024/11/07 01:18:40 NOTICE: (15)  : test 2. Run bisync without --create-empty-src-dirs
2024/11/07 01:18:40 NOTICE: (16)  : bisync
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : No changes found
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (17)  : test 3. Confirm the subdir exists only on Path1 and not Path2
2024/11/07 01:18:40 NOTICE: (18)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (19)  : list-dirs /tmp/011836si/createemptysrcdirs/path2/
2024/11/07 01:18:40 NOTICE: (20)  : test 4.Run bisync WITH --create-empty-src-dirs
2024/11/07 01:18:40 NOTICE: (21)  : bisync create-empty-src-dirs
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : - Path1    File is new               - subdir
2024/11/07 01:18:40 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : Applying changes
2024/11/07 01:18:40 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/createemptysrcdirs/path2/subdir
2024/11/07 01:18:40 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (22)  : test 5. Confirm the subdir exists on both paths
2024/11/07 01:18:40 NOTICE: (23)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (24)  : list-dirs /tmp/011836si/createemptysrcdirs/path2/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (25)  : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty)
2024/11/07 01:18:40 NOTICE: (26)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: (27)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.txt
2024/11/07 01:18:40 NOTICE: (28)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy1.txt
2024/11/07 01:18:40 NOTICE: (29)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy2.txt
2024/11/07 01:18:40 NOTICE: (30)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy3.txt
2024/11/07 01:18:40 NOTICE: (31)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy4.txt
2024/11/07 01:18:40 NOTICE: (32)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy5.txt
2024/11/07 01:18:40 NOTICE: (33)  : test 7. Run bisync without --create-empty-src-dirs
2024/11/07 01:18:40 NOTICE: (34)  : bisync
2024/11/07 01:18:40 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : - Path1    File was deleted          - RCLONE_TEST
2024/11/07 01:18:40 INFO  : - Path1    File was deleted          - subdir
2024/11/07 01:18:40 INFO  : Path1:    2 changes:    0 new,    0 modified,    2 deleted
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : - Path2    File was deleted          - subdir
2024/11/07 01:18:40 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:40 INFO  : Applying changes
2024/11/07 01:18:40 INFO  : - Path2    Queue delete              - /tmp/011836si/createemptysrcdirs/path2/RCLONE_TEST
2024/11/07 01:18:40 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:40 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (35)  : test 8. Confirm the subdir exists only on Path2 and not Path1
2024/11/07 01:18:40 NOTICE: (36)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: (37)  : list-dirs /tmp/011836si/createemptysrcdirs/path2/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (38)  : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs
2024/11/07 01:18:40 NOTICE: (39)  : bisync resync create-empty-src-dirs
2024/11/07 01:18:40 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:40 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:40 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:40 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:40 INFO  : Resync updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (40)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (41)  : list-dirs /tmp/011836si/createemptysrcdirs/path2/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (42)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: (43)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.txt
2024/11/07 01:18:40 NOTICE: (44)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy1.txt
2024/11/07 01:18:40 NOTICE: (45)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy2.txt
2024/11/07 01:18:40 NOTICE: (46)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy3.txt
2024/11/07 01:18:40 NOTICE: (47)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy4.txt
2024/11/07 01:18:40 NOTICE: (48)  : copy-as /tmp/011836si/datadir/test_createemptysrcdirs-vasisop0/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:18:40 INFO  : placeholder.txt: Copied (new) to: file1.copy5.txt
2024/11/07 01:18:40 NOTICE: (49)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: (50)  : list-dirs /tmp/011836si/createemptysrcdirs/path2/
2024/11/07 01:18:40 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:40 NOTICE: (51)  : bisync create-empty-src-dirs
2024/11/07 01:18:40 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : - Path1    File was deleted          - subdir
2024/11/07 01:18:40 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : Applying changes
2024/11/07 01:18:40 INFO  : - Path2    Queue delete              - /tmp/011836si/createemptysrcdirs/path2/subdir
2024/11/07 01:18:40 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:40 INFO  : subdir: Removing directory
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
2024/11/07 01:18:40 NOTICE: (52)  : test 10. Confirm the subdir has been removed on both paths
2024/11/07 01:18:40 NOTICE: (53)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/
2024/11/07 01:18:40 NOTICE: (54)  : list-dirs /tmp/011836si/createemptysrcdirs/path2/
2024/11/07 01:18:40 NOTICE: (55)  : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime)
2024/11/07 01:18:40 NOTICE: (56)  : bisync create-empty-src-dirs
2024/11/07 01:18:40 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:40 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:40 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" with Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:40 INFO  : Path1 checking for diffs
2024/11/07 01:18:40 INFO  : Path2 checking for diffs
2024/11/07 01:18:40 INFO  : No changes found
2024/11/07 01:18:40 INFO  : Updating listings
2024/11/07 01:18:40 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/createemptysrcdirs/path1/" vs Path2 "/tmp/011836si/createemptysrcdirs/path2/"
2024/11/07 01:18:40 INFO  : Bisync successful
    bisync_test.go:558: TEST createemptysrcdirs PASSED
=== RUN   TestBisyncRemoteLocal/dry_run
2024/11/07 01:18:40 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:40 DEBUG : path1: Making directory
2024/11/07 01:18:40 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:40 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/dry_run/path1"
2024/11/07 01:18:40 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:40 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:40 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:40 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:40 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/dry_run/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/dry_run/path2"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_dry_run/initial"
2024/11/07 01:18:40 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_dry_run-besedup6"
2024/11/07 01:18:40 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/initdir/test_dry_run-besedup6: Waiting for checks to finish
2024/11/07 01:18:40 DEBUG : Local file system at /tmp/011836si/initdir/test_dry_run-besedup6: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:41 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:41 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:41 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:41 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:41 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:41 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_dry_run/modfiles"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_dry_run-xajoboj4"
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/datadir/test_dry_run-xajoboj4: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/datadir/test_dry_run-xajoboj4: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:41 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:41 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:41 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:41 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:41 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:41 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:41 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:41 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:41 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:41 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:41 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:41 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:41 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: list [/rclone-test-jisagow5dego/011836si/dry_run/path1]
2024/11/07 01:18:41 ERROR : : error listing: directory not found
2024/11/07 01:18:41 ERROR : : error listing: directory not found
2024/11/07 01:18:41 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_dry_run-besedup6
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: list [/rclone-test-jisagow5dego/011836si/dry_run/path1]
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/RCLONE_TEST]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file1.txt]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file2.txt]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file3.txt]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: Waiting for transfers to finish
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file4.txt]
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file5.txt]
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file6.txt]
2024/11/07 01:18:41 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: update [/rclone-test-jisagow5dego/011836si/dry_run/path1/file7.txt]
2024/11/07 01:18:41 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:41 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/dry_run/path1: list [/rclone-test-jisagow5dego/011836si/dry_run/path1]
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/dry_run/path2: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/dry_run/path2: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:41 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:41 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:41 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:41 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:41 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:41 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:41 NOTICE: checking path2 Local file system at /tmp/011836si/dry_run/path2
2024/11/07 01:18:41 NOTICE: (01)  : test dry-run
2024/11/07 01:18:41 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:41 NOTICE: (03)  : bisync resync
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/" with Path2 "/tmp/011836si/dry_run/path2/"
2024/11/07 01:18:41 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:41 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:41 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:41 INFO  : Resync updating listings
2024/11/07 01:18:41 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/" vs Path2 "/tmp/011836si/dry_run/path2/"
2024/11/07 01:18:41 INFO  : Bisync successful
2024/11/07 01:18:41 NOTICE: (04)  : test new on path2 - file10
2024/11/07 01:18:41 NOTICE: (05)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/file10.txt /tmp/011836si/dry_run/path2/
2024/11/07 01:18:41 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:41 NOTICE: (06)  : test newer on path2 - file1
2024/11/07 01:18:41 NOTICE: (07)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/file1.txt /tmp/011836si/dry_run/path2/
2024/11/07 01:18:41 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:41 NOTICE: (08)  : test new on path1 - file11
2024/11/07 01:18:41 NOTICE: (09)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/dry_run/path1/
2024/11/07 01:18:41 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:41 NOTICE: (10)  : test newer on path1 - file2
2024/11/07 01:18:41 NOTICE: (11)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/dry_run/path1/
2024/11/07 01:18:41 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:41 NOTICE: (12)  : test deleted on path2 - file3
2024/11/07 01:18:41 NOTICE: (13)  : delete-file /tmp/011836si/dry_run/path2/file3.txt
2024/11/07 01:18:41 INFO  : file3.txt: Deleted
2024/11/07 01:18:41 NOTICE: (14)  : test deleted on path1 - file4
2024/11/07 01:18:41 NOTICE: (15)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/dry_run/path1/file4.txt
2024/11/07 01:18:41 INFO  : file4.txt: Deleted
2024/11/07 01:18:41 NOTICE: (16)  : test changed on path2 and on path1 - file5 (file5R, file5L)
2024/11/07 01:18:41 NOTICE: (17)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/ file5R.txt
2024/11/07 01:18:41 NOTICE: (18)  : copy-as /tmp/011836si/datadir/test_dry_run-xajoboj4/file5R.txt /tmp/011836si/dry_run/path2/ file5.txt
2024/11/07 01:18:41 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:41 NOTICE: (19)  : touch-glob 2001-03-04 /tmp/011836si/datadir/test_dry_run-xajoboj4/ file5L.txt
2024/11/07 01:18:41 NOTICE: (20)  : copy-as /tmp/011836si/datadir/test_dry_run-xajoboj4/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/dry_run/path1/ file5.txt
2024/11/07 01:18:41 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:41 NOTICE: (21)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:18:41 NOTICE: (22)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/file6.txt /tmp/011836si/dry_run/path2/
2024/11/07 01:18:41 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:41 NOTICE: (23)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/dry_run/path1/file6.txt
2024/11/07 01:18:41 INFO  : file6.txt: Deleted
2024/11/07 01:18:41 NOTICE: (24)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:18:41 NOTICE: (25)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_dry_run-xajoboj4/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/dry_run/path1/
2024/11/07 01:18:41 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:41 NOTICE: (26)  : delete-file /tmp/011836si/dry_run/path2/file7.txt
2024/11/07 01:18:41 INFO  : file7.txt: Deleted
2024/11/07 01:18:41 NOTICE: (27)  : test sync with dry-run and resync
2024/11/07 01:18:41 NOTICE: (28)  : bisync dry-run resync
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/" with Path2 "/tmp/011836si/dry_run/path2/"
2024/11/07 01:18:41 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:41 NOTICE: - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:41 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:18:41 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:41 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:18:41 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:18:41 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13)
2024/11/07 01:18:41 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39)
2024/11/07 01:18:41 INFO  : Resync updating listings
2024/11/07 01:18:41 INFO  : Bisync successful
2024/11/07 01:18:41 NOTICE: (29)  : copy-listings dryrun-resync
2024/11/07 01:18:41 NOTICE: (30)  : test sync with dry-run
2024/11/07 01:18:41 NOTICE: (31)  : bisync dry-run
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/" with Path2 "/tmp/011836si/dry_run/path2/"
2024/11/07 01:18:41 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:41 INFO  : Path1 checking for diffs
2024/11/07 01:18:41 NOTICE: - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:41 NOTICE: - Path1    File was deleted          - file4.txt
2024/11/07 01:18:41 NOTICE: - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:41 NOTICE: - Path1    File was deleted          - file6.txt
2024/11/07 01:18:41 NOTICE: - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:18:41 NOTICE: - Path1    File is new               - file11.txt
2024/11/07 01:18:41 INFO  : Path1:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:41 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:41 INFO  : Path2 checking for diffs
2024/11/07 01:18:41 NOTICE: - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:41 NOTICE: - Path2    File was deleted          - file3.txt
2024/11/07 01:18:41 NOTICE: - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:41 NOTICE: - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:18:41 NOTICE: - Path2    File was deleted          - file7.txt
2024/11/07 01:18:41 NOTICE: - Path2    File is new               - file10.txt
2024/11/07 01:18:41 INFO  : Path2:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:41 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:41 INFO  : Applying changes
2024/11/07 01:18:41 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:41 INFO  : Checking potential conflicts...
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/dry_run/path2: 1 differences found
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/dry_run/path2: 1 errors while checking
2024/11/07 01:18:41 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:41 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file11.txt
2024/11/07 01:18:41 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file2.txt
2024/11/07 01:18:41 NOTICE: - Path2    Queue delete              - /tmp/011836si/dry_run/path2/file4.txt
2024/11/07 01:18:41 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:41 NOTICE: file5.txt: Skipped rename as --dry-run is set
2024/11/07 01:18:41 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file5.txt.conflict1
2024/11/07 01:18:41 NOTICE: file5.txt: Skipped rename as --dry-run is set
2024/11/07 01:18:41 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file5.txt.conflict2
2024/11/07 01:18:41 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file6.txt
2024/11/07 01:18:41 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file7.txt
2024/11/07 01:18:41 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file1.txt
2024/11/07 01:18:41 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file10.txt
2024/11/07 01:18:41 NOTICE: - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file3.txt
2024/11/07 01:18:41 NOTICE: - Path2    Do queued copies to                - Path1
2024/11/07 01:18:41 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0)
2024/11/07 01:18:41 NOTICE: - Path1    Do queued copies to                - Path2
2024/11/07 01:18:41 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:41 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13)
2024/11/07 01:18:41 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0)
2024/11/07 01:18:41 INFO  : Updating listings
2024/11/07 01:18:41 INFO  : Bisync successful
2024/11/07 01:18:41 NOTICE: (32)  : copy-listings dryrun
2024/11/07 01:18:41 NOTICE: (33)  : test sync without dry-run
2024/11/07 01:18:41 NOTICE: (34)  : bisync
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/" with Path2 "/tmp/011836si/dry_run/path2/"
2024/11/07 01:18:41 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:41 INFO  : Path1 checking for diffs
2024/11/07 01:18:41 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:41 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:41 INFO  : - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:41 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:41 INFO  : - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:18:41 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:41 INFO  : Path1:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:41 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:41 INFO  : Path2 checking for diffs
2024/11/07 01:18:41 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:41 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:41 INFO  : - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:41 INFO  : - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:18:41 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:41 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:41 INFO  : Path2:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:41 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:41 INFO  : Applying changes
2024/11/07 01:18:41 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:41 INFO  : Checking potential conflicts...
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/dry_run/path2: 1 differences found
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/dry_run/path2: 1 errors while checking
2024/11/07 01:18:41 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:41 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file11.txt
2024/11/07 01:18:41 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file2.txt
2024/11/07 01:18:41 INFO  : - Path2    Queue delete              - /tmp/011836si/dry_run/path2/file4.txt
2024/11/07 01:18:41 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:41 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file5.txt.conflict1
2024/11/07 01:18:41 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:41 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file5.txt.conflict1
2024/11/07 01:18:41 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/dry_run/path2/file5.txt.conflict2
2024/11/07 01:18:41 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:41 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file5.txt.conflict2
2024/11/07 01:18:41 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file6.txt
2024/11/07 01:18:41 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/dry_run/path2/file7.txt
2024/11/07 01:18:41 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file1.txt
2024/11/07 01:18:41 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file10.txt
2024/11/07 01:18:41 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/file3.txt
2024/11/07 01:18:41 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:41 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:41 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:41 INFO  : file3.txt: Deleted
2024/11/07 01:18:41 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:41 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:41 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:41 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file4.txt: Deleted
2024/11/07 01:18:41 INFO  : Updating listings
2024/11/07 01:18:41 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/dry_run/path1/" vs Path2 "/tmp/011836si/dry_run/path2/"
2024/11/07 01:18:41 INFO  : Bisync successful
    bisync_test.go:558: TEST dry_run PASSED
=== RUN   TestBisyncRemoteLocal/equal
2024/11/07 01:18:41 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:41 DEBUG : path1: Making directory
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:41 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/equal/path1"
2024/11/07 01:18:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:41 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/equal/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/equal/path2"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_equal/initial"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_equal-kipibak6"
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/initdir/test_equal-kipibak6: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/initdir/test_equal-kipibak6: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_equal/modfiles"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_equal-livagoj3"
2024/11/07 01:18:41 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/datadir/test_equal-livagoj3: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/datadir/test_equal-livagoj3: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:18:41 DEBUG : file2.txt.fbf6b964.partial: renamed to: file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK
2024/11/07 01:18:41 DEBUG : file1R.txt.c0691a20.partial: renamed to: file1R.txt
2024/11/07 01:18:41 INFO  : file1R.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:18:41 DEBUG : file1L.txt.a9dc541c.partial: renamed to: file1L.txt
2024/11/07 01:18:41 INFO  : file1L.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: list [/rclone-test-jisagow5dego/011836si/equal/path1]
2024/11/07 01:18:41 ERROR : : error listing: directory not found
2024/11/07 01:18:41 ERROR : : error listing: directory not found
2024/11/07 01:18:41 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_equal-kipibak6
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: list [/rclone-test-jisagow5dego/011836si/equal/path1]
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: update [/rclone-test-jisagow5dego/011836si/equal/path1/RCLONE_TEST]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: update [/rclone-test-jisagow5dego/011836si/equal/path1/file1.txt]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: update [/rclone-test-jisagow5dego/011836si/equal/path1/file2.txt]
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/equal/path1: list [/rclone-test-jisagow5dego/011836si/equal/path1]
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:41 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/equal/path2: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/equal/path2: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 NOTICE: checking path2 Local file system at /tmp/011836si/equal/path2
2024/11/07 01:18:41 NOTICE: (01)  : test equal
2024/11/07 01:18:41 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:41 NOTICE: (03)  : bisync resync
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1/" with Path2 "/tmp/011836si/equal/path2/"
2024/11/07 01:18:41 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:41 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:41 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:41 INFO  : Resync updating listings
2024/11/07 01:18:41 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1/" vs Path2 "/tmp/011836si/equal/path2/"
2024/11/07 01:18:41 INFO  : Bisync successful
2024/11/07 01:18:41 NOTICE: (04)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:41 NOTICE: (05)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_equal-livagoj3/ file1R.txt
2024/11/07 01:18:41 NOTICE: (06)  : copy-as /tmp/011836si/datadir/test_equal-livagoj3/file1R.txt /tmp/011836si/equal/path2/ file1.txt
2024/11/07 01:18:41 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:41 NOTICE: (07)  : touch-glob 2001-03-04 /tmp/011836si/datadir/test_equal-livagoj3/ file1L.txt
2024/11/07 01:18:41 NOTICE: (08)  : copy-as /tmp/011836si/datadir/test_equal-livagoj3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/equal/path1/ file1.txt
2024/11/07 01:18:41 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:41 NOTICE: (09)  : test changed on both paths and identical - file2
2024/11/07 01:18:41 NOTICE: (10)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_equal-livagoj3/ file2.txt
2024/11/07 01:18:41 NOTICE: (11)  : copy-as /tmp/011836si/datadir/test_equal-livagoj3/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/equal/path1/ file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:41 NOTICE: (12)  : copy-as /tmp/011836si/datadir/test_equal-livagoj3/file2.txt /tmp/011836si/equal/path2/ file2.txt
2024/11/07 01:18:41 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:41 NOTICE: (13)  : test bisync run
2024/11/07 01:18:41 NOTICE: (14)  : bisync
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1/" with Path2 "/tmp/011836si/equal/path2/"
2024/11/07 01:18:41 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:41 INFO  : Path1 checking for diffs
2024/11/07 01:18:41 INFO  : - Path1    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:41 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:41 INFO  : Path1:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:41 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:18:41 INFO  : Path2 checking for diffs
2024/11/07 01:18:41 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:41 INFO  : - Path2    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:41 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:41 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:18:41 INFO  : Applying changes
2024/11/07 01:18:41 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:41 INFO  : Checking potential conflicts...
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/equal/path2: 1 differences found
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/equal/path2: 1 errors while checking
2024/11/07 01:18:41 NOTICE: Local file system at /tmp/011836si/equal/path2: 1 matching files
2024/11/07 01:18:41 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:41 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:41 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1/file1.txt.conflict1
2024/11/07 01:18:41 INFO  : file1.txt: Moved (server-side) to: file1.txt.conflict1
2024/11/07 01:18:41 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/equal/path2/file1.txt.conflict1
2024/11/07 01:18:41 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/equal/path2/file1.txt.conflict2
2024/11/07 01:18:41 INFO  : file1.txt: Moved (server-side) to: file1.txt.conflict2
2024/11/07 01:18:41 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1/file1.txt.conflict2
2024/11/07 01:18:41 NOTICE: - WARNING  New or changed in both paths       - file2.txt
2024/11/07 01:18:41 INFO  : Files are equal! Skipping: file2.txt
2024/11/07 01:18:41 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:41 INFO  : file1.txt.conflict2: Copied (new)
2024/11/07 01:18:41 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:41 INFO  : file1.txt.conflict1: Copied (new)
2024/11/07 01:18:41 INFO  : Updating listings
2024/11/07 01:18:41 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:41 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:41 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/equal/path1/" vs Path2 "/tmp/011836si/equal/path2/"
2024/11/07 01:18:41 INFO  : Bisync successful
    bisync_test.go:558: TEST equal PASSED
=== RUN   TestBisyncRemoteLocal/ext_paths
2024/11/07 01:18:41 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:41 DEBUG : path1: Making directory
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:41 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/ext_paths/path1"
2024/11/07 01:18:41 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:41 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:41 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:41 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:41 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/ext_paths/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/ext_paths/path2"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ext_paths/initial"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_ext_paths-zagifug2"
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ: Making directory with metadata
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z)
2024/11/07 01:18:41 DEBUG : Added delayed dir = "測試Ру��кий  ěáñ", newDst=測試Ру��кий  ěáñ
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/initdir/test_ext_paths-zagifug2: Waiting for checks to finish
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/initdir/test_ext_paths-zagifug2: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:41 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:41 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : 測試_check file.5028a97.partial: renamed to: 測試_check file
2024/11/07 01:18:41 INFO  : 測試_check file: Copied (new)
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:41 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:41 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file.5028a97.partial: renamed to: 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ext_paths/modfiles"
2024/11/07 01:18:41 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_ext_paths-sihiwoh7"
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/datadir/test_ext_paths-sihiwoh7: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/datadir/test_ext_paths-sihiwoh7: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:41 DEBUG : file1.txt.917a74a1.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:18:41 DEBUG : 測試_filtersfile.txt.1c47c956.partial: renamed to: 測試_filtersfile.txt
2024/11/07 01:18:41 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: list [/rclone-test-jisagow5dego/011836si/ext_paths/path1]
2024/11/07 01:18:41 ERROR : : error listing: directory not found
2024/11/07 01:18:41 ERROR : : error listing: directory not found
2024/11/07 01:18:41 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_ext_paths-zagifug2
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: list [/rclone-test-jisagow5dego/011836si/ext_paths/path1]
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ: Making directory
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: mkdir [/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/RCLONE_TEST]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/file1.txt]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/filename_contains_ě_.txt]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/file_enconde_mañana_funcionará.txt]
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: Waiting for transfers to finish
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/filename_contains_ࢺ_.txt]
2024/11/07 01:18:41 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/Ру��кий.txt]
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試_check file]
2024/11/07 01:18:41 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/filename_contains_ě_.txt]
2024/11/07 01:18:41 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt]
2024/11/07 01:18:41 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: update [/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/測試_check file]
2024/11/07 01:18:41 INFO  : 測試_check file: Copied (new)
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:41 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: list [/rclone-test-jisagow5dego/011836si/ext_paths/path1]
2024/11/07 01:18:41 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1: list [/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ]
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ: Making directory with metadata
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z)
2024/11/07 01:18:41 DEBUG : Added delayed dir = "測試Ру��кий  ěáñ", newDst=測試Ру��кий  ěáñ
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/ext_paths/path2: Waiting for checks to finish
2024/11/07 01:18:41 DEBUG : Local file system at /tmp/011836si/ext_paths/path2: Waiting for transfers to finish
2024/11/07 01:18:41 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:41 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:41 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:41 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : 測試_check file.5028a97.partial: renamed to: 測試_check file
2024/11/07 01:18:41 INFO  : 測試_check file: Copied (new)
2024/11/07 01:18:41 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:41 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:41 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:41 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/測試_check file.5028a97.partial: renamed to: 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:41 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:41 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:41 NOTICE: checking path2 Local file system at /tmp/011836si/ext_paths/path2
2024/11/07 01:18:41 NOTICE: (01)  : test extended-char-paths
2024/11/07 01:18:41 NOTICE: (02)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/
2024/11/07 01:18:41 ERROR : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-dozehic1: Server side directory move failed: rename /rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěa�ñ: file does not exist
2024/11/07 01:18:41 INFO  : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists
2024/11/07 01:18:41 ERROR : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-dozehic1: error reading source root directory: directory not found
2024/11/07 01:18:41 NOTICE: (03)  : fix-names /tmp/011836si/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/
2024/11/07 01:18:41 ERROR : Local file system at /tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-riyuzaq5: Server side directory move failed: rename /tmp/011836si/ext_paths/path2/測試Ру��кий  ěa�ñ /tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-riyuzaq5: no such file or directory
2024/11/07 01:18:41 INFO  : Local file system at /tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists
2024/11/07 01:18:41 ERROR : Local file system at /tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-riyuzaq5: error reading source root directory: directory not found
2024/11/07 01:18:41 NOTICE: (04)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:41 NOTICE: (05)  : fix-names /tmp/011836si/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:41 NOTICE: (06)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:41 NOTICE: (07)  : fix-names /tmp/011836si/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:41 NOTICE: (08)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試_check{spc}file
2024/11/07 01:18:41 NOTICE: (09)  : fix-names /tmp/011836si/ext_paths/path2/測試_check{spc}file
2024/11/07 01:18:41 NOTICE: (10)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:41 NOTICE: (11)  : fix-names /tmp/011836si/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:41 NOTICE: (12)  : test resync subdirs with extended chars
2024/11/07 01:18:41 NOTICE: (13)  : bisync subdir=測試Ру��кий{spc}{spc}ěáñ resync
2024/11/07 01:18:41 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:41 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:41 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/" with Path2 "/tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:41 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:41 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:41 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:41 INFO  : Resync updating listings
2024/11/07 01:18:41 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/" vs Path2 "/tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:41 INFO  : Bisync successful
2024/11/07 01:18:41 NOTICE: (14)  : copy-listings resync
2024/11/07 01:18:41 NOTICE: (15)  : test place new files with extended chars on each side
2024/11/07 01:18:41 NOTICE: (16)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_ext_paths-sihiwoh7/ file1.txt
2024/11/07 01:18:41 NOTICE: (17)  : copy-as /tmp/011836si/datadir/test_ext_paths-sihiwoh7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ 測試_file1p1
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new) to: 測試_file1p1
2024/11/07 01:18:41 NOTICE: (18)  : copy-as /tmp/011836si/datadir/test_ext_paths-sihiwoh7/file1.txt /tmp/011836si/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ 測試_file1p2
2024/11/07 01:18:41 INFO  : file1.txt: Copied (new) to: 測試_file1p2
2024/11/07 01:18:41 NOTICE: (19)  : test normal sync of subdirs with extended chars
2024/11/07 01:18:41 NOTICE: (20)  : bisync subdir=測試Ру��кий{spc}{spc}ěáñ
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/" with Path2 "/tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:42 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:42 INFO  : Path1 checking for diffs
2024/11/07 01:18:42 INFO  : - Path1    File is new               - 測試_file1p1
2024/11/07 01:18:42 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:42 INFO  : Path2 checking for diffs
2024/11/07 01:18:42 INFO  : - Path2    File is new               - 測試_file1p2
2024/11/07 01:18:42 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:42 INFO  : Applying changes
2024/11/07 01:18:42 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ/測試_file1p1
2024/11/07 01:18:42 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/測試_file1p2
2024/11/07 01:18:42 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:42 INFO  : 測試_file1p2: Copied (new)
2024/11/07 01:18:42 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:42 INFO  : 測試_file1p1: Copied (new)
2024/11/07 01:18:42 INFO  : Updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий  ěáñ/" vs Path2 "/tmp/011836si/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:42 INFO  : Bisync successful
2024/11/07 01:18:42 NOTICE: (21)  : move-listings normal-sync
2024/11/07 01:18:42 NOTICE: (22)  : test check-filename with extended chars. check should fail.
2024/11/07 01:18:42 NOTICE: (23)  : bisync resync
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" with Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:42 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:42 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:42 INFO  : Resync updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" vs Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
2024/11/07 01:18:42 NOTICE: (24)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:42 INFO  : 測試_check file: Deleted
2024/11/07 01:18:42 NOTICE: (25)  : bisync check-access check-filename=測試_check{spc}file
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" with Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:42 INFO  : Path1 checking for diffs
2024/11/07 01:18:42 INFO  : - Path1    File was deleted          - 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:42 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:42 INFO  : Path2 checking for diffs
2024/11/07 01:18:42 INFO  : Checking access health
2024/11/07 01:18:42 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file
2024/11/07 01:18:42 ERROR : -          Access test failed: Path2 file not found in Path1 - 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:42 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:42 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:42 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:42 NOTICE: (26)  : copy-listings check-access-fail
2024/11/07 01:18:42 NOTICE: (27)  : test check-filename with extended chars. check should pass.
2024/11/07 01:18:42 NOTICE: (28)  : bisync resync
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" with Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:42 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:42 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:42 INFO  : Resync updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" vs Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
2024/11/07 01:18:42 NOTICE: (29)  : bisync check-access check-filename=測試_check{spc}file
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" with Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:42 INFO  : Path1 checking for diffs
2024/11/07 01:18:42 INFO  : Path2 checking for diffs
2024/11/07 01:18:42 INFO  : Checking access health
2024/11/07 01:18:42 INFO  : Found 2 matching "測試_check file" files on both paths
2024/11/07 01:18:42 INFO  : No changes found
2024/11/07 01:18:42 INFO  : Updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" vs Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
2024/11/07 01:18:42 NOTICE: (30)  : move-listings check-access-pass
2024/11/07 01:18:42 NOTICE: (31)  : test filters-file path with extended chars - masks /fileZ.txt
2024/11/07 01:18:42 NOTICE: (32)  : copy-file /tmp/011836si/datadir/test_ext_paths-sihiwoh7/測試_filtersfile.txt /tmp/011836si/workdir/
2024/11/07 01:18:42 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:18:42 NOTICE: (33)  : bisync filters-file=/tmp/011836si/workdir/測試_filtersfile.txt resync
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" with Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Using filters file /tmp/011836si/workdir/測試_filtersfile.txt
2024/11/07 01:18:42 INFO  : Storing filters file hash to /tmp/011836si/workdir/測試_filtersfile.txt.md5
2024/11/07 01:18:42 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:42 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:42 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:42 INFO  : Resync updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" vs Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
2024/11/07 01:18:42 NOTICE: (34)  : copy-as /tmp/011836si/datadir/test_ext_paths-sihiwoh7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ext_paths/path1/ fileZ.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new) to: fileZ.txt
2024/11/07 01:18:42 NOTICE: (35)  : bisync filters-file=/tmp/011836si/workdir/測試_filtersfile.txt
2024/11/07 01:18:42 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" with Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Using filters file /tmp/011836si/workdir/測試_filtersfile.txt
2024/11/07 01:18:42 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:42 INFO  : Path1 checking for diffs
2024/11/07 01:18:42 INFO  : Path2 checking for diffs
2024/11/07 01:18:42 INFO  : No changes found
2024/11/07 01:18:42 INFO  : Updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ext_paths/path1/" vs Path2 "/tmp/011836si/ext_paths/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
    bisync_test.go:558: TEST ext_paths PASSED
=== RUN   TestBisyncRemoteLocal/extended_filenames
2024/11/07 01:18:42 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:42 DEBUG : path1: Making directory
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:42 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/extended_filenames/path1"
2024/11/07 01:18:42 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:42 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:42 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/extended_filenames/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/extended_filenames/path1"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/extended_filenames/path2"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_extended_filenames/initial"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_extended_filenames-bukeyev6"
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_: Making directory with metadata
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:42 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_
2024/11/07 01:18:42 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt.5028a97.partial: renamed to: file1 - Copy.txt
2024/11/07 01:18:42 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/initdir/test_extended_filenames-bukeyev6: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/initdir/test_extended_filenames-bukeyev6: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:42 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:42 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt.5028a97.partial: renamed to: file1 - Copy (2).txt
2024/11/07 01:18:42 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:18:42 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:42 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:42 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:42 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_extended_filenames/modfiles"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_extended_filenames-jahaqiy7"
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/datadir/test_extended_filenames-jahaqiy7: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/datadir/test_extended_filenames-jahaqiy7: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:42 DEBUG : file1.txt.f73bbb59.partial: renamed to: file1.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK
2024/11/07 01:18:42 DEBUG : file2.txt.761be064.partial: renamed to: file2.txt
2024/11/07 01:18:42 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: list [/rclone-test-jisagow5dego/011836si/extended_filenames/path1]
2024/11/07 01:18:42 ERROR : : error listing: directory not found
2024/11/07 01:18:42 ERROR : : error listing: directory not found
2024/11/07 01:18:42 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_extended_filenames-bukeyev6
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: list [/rclone-test-jisagow5dego/011836si/extended_filenames/path1]
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_: Making directory
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: mkdir [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/subdir_with_ࢺ_]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/RCLONE_TEST]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/file1 - Copy (2).txt]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/file1 - Copy.txt]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/file1.txt]
2024/11/07 01:18:42 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: Waiting for transfers to finish
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/file_enconde_mañana_funcionará.txt]
2024/11/07 01:18:42 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/filename_contains_ě_.txt]
2024/11/07 01:18:42 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/filename_contains_ࢺ_.txt]
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/Ру��кий.txt]
2024/11/07 01:18:42 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ě_.txt]
2024/11/07 01:18:42 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: update [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_.txt]
2024/11/07 01:18:42 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:42 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:42 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: list [/rclone-test-jisagow5dego/011836si/extended_filenames/path1]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1: list [/rclone-test-jisagow5dego/011836si/extended_filenames/path1/subdir_with_ࢺ_]
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_: Making directory with metadata
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:42 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_
2024/11/07 01:18:42 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1 - Copy (2).txt.5028a97.partial: renamed to: file1 - Copy (2).txt
2024/11/07 01:18:42 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/extended_filenames/path2: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/extended_filenames/path2: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : file1 - Copy.txt.5028a97.partial: renamed to: file1 - Copy.txt
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:42 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:42 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:42 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:42 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:42 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt
2024/11/07 01:18:42 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir_with_ࢺ_: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 NOTICE: checking path2 Local file system at /tmp/011836si/extended_filenames/path2
2024/11/07 01:18:42 NOTICE: (01)  : test extended-filenames
2024/11/07 01:18:42 NOTICE: (02)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/extended_filenames/path1/subdir_with_ࢺ_/
2024/11/07 01:18:42 NOTICE: (03)  : fix-names /tmp/011836si/extended_filenames/path2/subdir_with_ࢺ_/
2024/11/07 01:18:42 NOTICE: (04)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:42 NOTICE: (05)  : fix-names /tmp/011836si/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:42 NOTICE: (06)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/extended_filenames/path1/Ру��кий.txt
2024/11/07 01:18:42 NOTICE: (07)  : fix-names /tmp/011836si/extended_filenames/path2/Ру��кий.txt
2024/11/07 01:18:42 NOTICE: (08)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/extended_filenames/path1/file_enconde_mañana_funcionará.txt
2024/11/07 01:18:42 NOTICE: (09)  : fix-names /tmp/011836si/extended_filenames/path2/file_enconde_mañana_funcionará.txt
2024/11/07 01:18:42 NOTICE: (10)  : test initial bisync
2024/11/07 01:18:42 NOTICE: (11)  : bisync resync
2024/11/07 01:18:42 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:42 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:18:42 NOTICE: Local file system at /tmp/011836si/extended_filenames/path2: Replacing invalid UTF-8 characters in "ě\x81\xfe a�ñhࢺ_測試Ру�кийěa�ñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬e�ö"
2024/11/07 01:18:42 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:42 NOTICE: Local file system at /tmp/011836si/extended_filenames/path2: Replacing invalid UTF-8 characters in "ě\x81\xfe áñhࢺ_測試Ру�кийěáñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö"
2024/11/07 01:18:42 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
    bisync_test.go:1024: Fs is incapable of running test as the paths produce different results, skipping: extended_filenames (path1: 
        РуÑ�Ñ�кий.txtÄ›�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö (NFC) path2: 
        file1 - Copy (2).txtfile1 - Copy (2).txt (file1 - Copy (2).txtfile1 - Copy (2).txt))
         (fs1: hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/extended_filenames/path1 fs2: Local file system at /tmp/011836si/extended_filenames/path2) 
        @@ -1 +1 @@
        -РуÑ�Ñ�кий.txtÄ›�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö+file1 - Copy (2).txtfile1 - Copy (2).txt
=== RUN   TestBisyncRemoteLocal/filters
2024/11/07 01:18:42 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:42 DEBUG : path1: Making directory
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:42 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/filters/path1"
2024/11/07 01:18:42 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:42 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:42 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filters/path1"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/filters/path2"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/initial"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_filters-pogebuh0"
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:42 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:42 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:42 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/initdir/test_filters-pogebuh0: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/initdir/test_filters-pogebuh0: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:42 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:42 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:42 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:42 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:42 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:42 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:42 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/modfiles"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_filters-zozucon0"
2024/11/07 01:18:42 DEBUG : fileZ.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/datadir/test_filters-zozucon0: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/datadir/test_filters-zozucon0: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:42 DEBUG : fileZ.txt.925c801f.partial: renamed to: fileZ.txt
2024/11/07 01:18:42 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:18:42 DEBUG : filtersfile.flt.9f8671d3.partial: renamed to: filtersfile.flt
2024/11/07 01:18:42 INFO  : filtersfile.flt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: list [/rclone-test-jisagow5dego/011836si/filters/path1]
2024/11/07 01:18:42 ERROR : : error listing: directory not found
2024/11/07 01:18:42 ERROR : : error listing: directory not found
2024/11/07 01:18:42 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_filters-pogebuh0
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: list [/rclone-test-jisagow5dego/011836si/filters/path1]
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir: Making directory
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: mkdir [/rclone-test-jisagow5dego/011836si/filters/path1/subdir]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/RCLONE_TEST]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file1.txt]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file2.txt]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file3.txt]
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: Waiting for transfers to finish
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file4.txt]
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file5.txt]
2024/11/07 01:18:42 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file6.txt]
2024/11/07 01:18:42 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/file7.txt]
2024/11/07 01:18:42 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: update [/rclone-test-jisagow5dego/011836si/filters/path1/subdir/file20.txt]
2024/11/07 01:18:42 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:42 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:42 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:42 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: list [/rclone-test-jisagow5dego/011836si/filters/path1]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filters/path1: list [/rclone-test-jisagow5dego/011836si/filters/path1/subdir]
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:42 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:42 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:42 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/filters/path2: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/filters/path2: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:42 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:42 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:42 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:42 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:42 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:42 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:42 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 NOTICE: checking path2 Local file system at /tmp/011836si/filters/path2
2024/11/07 01:18:42 NOTICE: (01)  : test filters
2024/11/07 01:18:42 NOTICE: (02)  : copy-file /tmp/011836si/datadir/test_filters-zozucon0/filtersfile.flt /tmp/011836si/workdir/
2024/11/07 01:18:42 INFO  : filtersfile.flt: Copied (new)
2024/11/07 01:18:42 NOTICE: (03)  : test resync to force building of the filters md5 hash
2024/11/07 01:18:42 NOTICE: (04)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.flt resync
2024/11/07 01:18:42 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filters/path1/" with Path2 "/tmp/011836si/filters/path2/"
2024/11/07 01:18:42 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.flt
2024/11/07 01:18:42 INFO  : Storing filters file hash to /tmp/011836si/workdir/filtersfile.flt.md5
2024/11/07 01:18:42 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:42 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:42 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:42 INFO  : Resync updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filters/path1/" vs Path2 "/tmp/011836si/filters/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
2024/11/07 01:18:42 NOTICE: (05)  : copy-listings resync
2024/11/07 01:18:42 NOTICE: (06)  : test place new files on the remote
2024/11/07 01:18:42 NOTICE: (07)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_filters-zozucon0/ fileZ.txt
2024/11/07 01:18:42 NOTICE: (08)  : copy-as /tmp/011836si/datadir/test_filters-zozucon0/fileZ.txt /tmp/011836si/filters/path2/ fileZ.txt
2024/11/07 01:18:42 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:18:42 NOTICE: (09)  : copy-as /tmp/011836si/datadir/test_filters-zozucon0/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/filters/path1/subdir fileZ.txt
2024/11/07 01:18:42 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:18:42 NOTICE: (10)  : test bisync with filters-file. path2-side fileZ.txt will be filtered.
2024/11/07 01:18:42 NOTICE: (11)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.flt
2024/11/07 01:18:42 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:42 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:42 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filters/path1/" with Path2 "/tmp/011836si/filters/path2/"
2024/11/07 01:18:42 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.flt
2024/11/07 01:18:42 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:42 INFO  : Path1 checking for diffs
2024/11/07 01:18:42 INFO  : - Path1    File is new               - subdir/fileZ.txt
2024/11/07 01:18:42 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:42 INFO  : Path2 checking for diffs
2024/11/07 01:18:42 INFO  : Applying changes
2024/11/07 01:18:42 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/filters/path2/subdir/fileZ.txt
2024/11/07 01:18:42 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:42 INFO  : subdir/fileZ.txt: Copied (new)
2024/11/07 01:18:42 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 INFO  : Updating listings
2024/11/07 01:18:42 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filters/path1/" vs Path2 "/tmp/011836si/filters/path2/"
2024/11/07 01:18:42 INFO  : Bisync successful
    bisync_test.go:558: TEST filters PASSED
=== RUN   TestBisyncRemoteLocal/filtersfile_checks
2024/11/07 01:18:42 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:42 DEBUG : path1: Making directory
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:42 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1"
2024/11/07 01:18:42 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:42 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:42 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:42 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:42 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/filtersfile_checks/path2"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filtersfile_checks/initial"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_filtersfile_checks-gopomav7"
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:42 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:42 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/initdir/test_filtersfile_checks-gopomav7: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/initdir/test_filtersfile_checks-gopomav7: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:42 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:42 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:42 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:42 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:42 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:42 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:42 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filtersfile_checks/modfiles"
2024/11/07 01:18:42 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_filtersfile_checks-ruqoboy6"
2024/11/07 01:18:42 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/datadir/test_filtersfile_checks-ruqoboy6: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : Local file system at /tmp/011836si/datadir/test_filtersfile_checks-ruqoboy6: Waiting for transfers to finish
2024/11/07 01:18:42 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK
2024/11/07 01:18:42 DEBUG : filtersfile.txt.f1af69b0.partial: renamed to: filtersfile.txt
2024/11/07 01:18:42 INFO  : filtersfile.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:42 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:42 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK
2024/11/07 01:18:42 DEBUG : filtersfile2.txt.9f8671d3.partial: renamed to: filtersfile2.txt
2024/11/07 01:18:42 INFO  : filtersfile2.txt: Copied (new)
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: list [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1]
2024/11/07 01:18:42 ERROR : : error listing: directory not found
2024/11/07 01:18:42 ERROR : : error listing: directory not found
2024/11/07 01:18:42 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_filtersfile_checks-gopomav7
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: list [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1]
2024/11/07 01:18:42 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : subdir: Making directory
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: mkdir [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/subdir]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: update [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/RCLONE_TEST]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: update [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/file1.txt]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: update [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/file2.txt]
2024/11/07 01:18:42 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: update [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/subdir/file20.txt]
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: Waiting for checks to finish
2024/11/07 01:18:42 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: Waiting for transfers to finish
2024/11/07 01:18:43 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: list [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1: list [/rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/subdir]
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:43 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:43 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:43 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:43 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/filtersfile_checks/path2: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/filtersfile_checks/path2: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:43 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 NOTICE: checking path2 Local file system at /tmp/011836si/filtersfile_checks/path2
2024/11/07 01:18:43 NOTICE: (01)  : test filtersfile-checks
2024/11/07 01:18:43 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:43 NOTICE: (03)  : bisync resync
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:43 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:43 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:43 INFO  : Resync updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" vs Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (04)  : test 1. inject filters file in workdir.
2024/11/07 01:18:43 NOTICE: (05)  : copy-file /tmp/011836si/datadir/test_filtersfile_checks-ruqoboy6/filtersfile.txt /tmp/011836si/workdir/
2024/11/07 01:18:43 INFO  : filtersfile.txt: Copied (new)
2024/11/07 01:18:43 NOTICE: (06)  : test 2. run with filters-file but without md5. should abort.
2024/11/07 01:18:43 NOTICE: (07)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:43 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:43 NOTICE: (08)  : test 3. run without filters-file. should be blocked due to prior abort.
2024/11/07 01:18:43 NOTICE: (09)  : bisync
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_filtersfile_checks_path1..tmp_011836si_filtersfile_checks_path2.path1.lst
Path2: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_filtersfile_checks_path1..tmp_011836si_filtersfile_checks_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011836si/workdir"
2024/11/07 01:18:43 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:43 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:43 NOTICE: (10)  : test 4. run with filters-file and resync.
2024/11/07 01:18:43 NOTICE: (11)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.txt resync
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : Storing filters file hash to /tmp/011836si/workdir/filtersfile.txt.md5
2024/11/07 01:18:43 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:43 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:43 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:43 INFO  : Resync updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" vs Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (12)  : test 5. run with filters-file alone. should run.
2024/11/07 01:18:43 NOTICE: (13)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:43 INFO  : Path1 checking for diffs
2024/11/07 01:18:43 INFO  : Path2 checking for diffs
2024/11/07 01:18:43 INFO  : No changes found
2024/11/07 01:18:43 INFO  : Updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" vs Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (14)  : test 6. push changed filters-file to workdir.
2024/11/07 01:18:43 NOTICE: (15)  : copy-as /tmp/011836si/datadir/test_filtersfile_checks-ruqoboy6/filtersfile2.txt /tmp/011836si/workdir/ filtersfile.txt
2024/11/07 01:18:43 INFO  : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt
2024/11/07 01:18:43 NOTICE: (16)  : test 7. run with filters-file alone. should abort.
2024/11/07 01:18:43 NOTICE: (17)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:43 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:43 NOTICE: (18)  : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort.
2024/11/07 01:18:43 NOTICE: (19)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.txt resync dry-run
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : Skipped storing filters file hash to /tmp/011836si/workdir/filtersfile.txt.md5 as --dry-run is set
2024/11/07 01:18:43 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:43 NOTICE: - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:43 NOTICE: - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:43 INFO  : Resync updating listings
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (20)  : test 9. run with filters-file alone. should abort.
2024/11/07 01:18:43 NOTICE: (21)  : bisync filters-file=/tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/filtersfile_checks/path1/" with Path2 "/tmp/011836si/filtersfile_checks/path2/"
2024/11/07 01:18:43 INFO  : Using filters file /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/011836si/workdir/filtersfile.txt
2024/11/07 01:18:43 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:43 NOTICE: Bisync error: bisync aborted
    bisync_test.go:558: TEST filtersfile_checks PASSED
=== RUN   TestBisyncRemoteLocal/ignorelistingchecksum
2024/11/07 01:18:43 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:43 DEBUG : path1: Making directory
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:43 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1"
2024/11/07 01:18:43 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:43 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:43 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/ignorelistingchecksum/path2"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ignorelistingchecksum/initial"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_ignorelistingchecksum-lukitov5"
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:43 INFO  : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:43 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/initdir/test_ignorelistingchecksum-lukitov5: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/initdir/test_ignorelistingchecksum-lukitov5: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:43 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:43 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:43 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:43 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:43 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:43 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:43 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:43 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_ignorelistingchecksum/modfiles"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_ignorelistingchecksum-duxepiy1"
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/datadir/test_ignorelistingchecksum-duxepiy1: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/datadir/test_ignorelistingchecksum-duxepiy1: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:43 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: list [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1]
2024/11/07 01:18:43 ERROR : : error listing: directory not found
2024/11/07 01:18:43 ERROR : : error listing: directory not found
2024/11/07 01:18:43 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_ignorelistingchecksum-lukitov5
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: list [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1]
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : subdir: Making directory
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: mkdir [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/subdir]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/RCLONE_TEST]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.copy1.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.copy2.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.copy3.txt]
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: Waiting for transfers to finish
2024/11/07 01:18:43 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.copy4.txt]
2024/11/07 01:18:43 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.copy5.txt]
2024/11/07 01:18:43 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.txt]
2024/11/07 01:18:43 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: update [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/subdir/file20.txt]
2024/11/07 01:18:43 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:43 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: list [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1: list [/rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/subdir]
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:43 INFO  : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:43 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:43 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:43 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:43 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:43 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:43 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/ignorelistingchecksum/path2: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/ignorelistingchecksum/path2: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:43 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:43 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:43 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:43 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 NOTICE: checking path2 Local file system at /tmp/011836si/ignorelistingchecksum/path2
2024/11/07 01:18:43 NOTICE: (01)  : test basic
2024/11/07 01:18:43 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:43 NOTICE: (03)  : bisync resync
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/" with Path2 "/tmp/011836si/ignorelistingchecksum/path2/"
2024/11/07 01:18:43 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:43 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:43 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:43 INFO  : Resync updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/" vs Path2 "/tmp/011836si/ignorelistingchecksum/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (04)  : bisync resync ignore-listing-checksum
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/" with Path2 "/tmp/011836si/ignorelistingchecksum/path2/"
2024/11/07 01:18:43 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:43 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:43 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:43 INFO  : Resync updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/" vs Path2 "/tmp/011836si/ignorelistingchecksum/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (05)  : test place newer files on both paths
2024/11/07 01:18:43 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_ignorelistingchecksum-duxepiy1/file1.txt /tmp/011836si/ignorelistingchecksum/path2/
2024/11/07 01:18:43 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:43 NOTICE: (07)  : copy-as /tmp/011836si/datadir/test_ignorelistingchecksum-duxepiy1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/subdir file20.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (replaced existing) to: file20.txt
2024/11/07 01:18:43 NOTICE: (08)  : test bisync run
2024/11/07 01:18:43 NOTICE: (09)  : bisync ignore-listing-checksum
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/" with Path2 "/tmp/011836si/ignorelistingchecksum/path2/"
2024/11/07 01:18:43 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:43 INFO  : Path1 checking for diffs
2024/11/07 01:18:43 INFO  : - Path1    File changed: size (larger), time (newer) - subdir/file20.txt
2024/11/07 01:18:43 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:43 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:43 INFO  : Path2 checking for diffs
2024/11/07 01:18:43 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:43 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:43 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:43 INFO  : Applying changes
2024/11/07 01:18:43 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/ignorelistingchecksum/path2/subdir/file20.txt
2024/11/07 01:18:43 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/file1.txt
2024/11/07 01:18:43 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:43 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:43 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:43 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:43 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:43 INFO  : Updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/ignorelistingchecksum/path1/" vs Path2 "/tmp/011836si/ignorelistingchecksum/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
    bisync_test.go:558: TEST ignorelistingchecksum PASSED
=== RUN   TestBisyncRemoteLocal/max_delete_path1
2024/11/07 01:18:43 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:43 DEBUG : path1: Making directory
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:43 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/max_delete_path1/path1"
2024/11/07 01:18:43 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:43 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:43 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/max_delete_path1/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/max_delete_path1/path2"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path1/initial"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_max_delete_path1-hihigus5"
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/initdir/test_max_delete_path1-hihigus5: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:43 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:43 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:43 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/initdir/test_max_delete_path1-hihigus5: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:43 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:43 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:43 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:43 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:43 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path1/modfiles"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_max_delete_path1-kediqeq6"
2024/11/07 01:18:43 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/datadir/test_max_delete_path1-kediqeq6: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/datadir/test_max_delete_path1-kediqeq6: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:43 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:43 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: list [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1]
2024/11/07 01:18:43 ERROR : : error listing: directory not found
2024/11/07 01:18:43 ERROR : : error listing: directory not found
2024/11/07 01:18:43 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_max_delete_path1-hihigus5
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: list [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1]
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file1.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file2.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file3.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file4.txt]
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file5.txt]
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file6.txt]
2024/11/07 01:18:43 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file7.txt]
2024/11/07 01:18:43 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file8.txt]
2024/11/07 01:18:43 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file9.txt]
2024/11/07 01:18:43 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:43 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path1/path1: list [/rclone-test-jisagow5dego/011836si/max_delete_path1/path1]
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/max_delete_path1/path2: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/max_delete_path1/path2: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:43 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:43 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:43 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:43 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:43 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:43 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:43 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:43 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:43 NOTICE: checking path2 Local file system at /tmp/011836si/max_delete_path1/path2
2024/11/07 01:18:43 NOTICE: (01)  : test max-delete-path1
2024/11/07 01:18:43 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:43 NOTICE: (03)  : bisync resync
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1/" with Path2 "/tmp/011836si/max_delete_path1/path2/"
2024/11/07 01:18:43 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:43 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:43 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:43 INFO  : Resync updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1/" vs Path2 "/tmp/011836si/max_delete_path1/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
2024/11/07 01:18:43 NOTICE: (04)  : test delete >50% of local files
2024/11/07 01:18:43 NOTICE: (05)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Deleted
2024/11/07 01:18:43 NOTICE: (06)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file2.txt
2024/11/07 01:18:43 INFO  : file2.txt: Deleted
2024/11/07 01:18:43 NOTICE: (07)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file3.txt
2024/11/07 01:18:43 INFO  : file3.txt: Deleted
2024/11/07 01:18:43 NOTICE: (08)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file4.txt
2024/11/07 01:18:43 INFO  : file4.txt: Deleted
2024/11/07 01:18:43 NOTICE: (09)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/max_delete_path1/path1/file5.txt
2024/11/07 01:18:43 INFO  : file5.txt: Deleted
2024/11/07 01:18:43 NOTICE: (10)  : test sync should fail due to too many local deletes
2024/11/07 01:18:43 NOTICE: (11)  : bisync
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1/" with Path2 "/tmp/011836si/max_delete_path1/path2/"
2024/11/07 01:18:43 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:43 INFO  : Path1 checking for diffs
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file1.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file2.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file3.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file5.txt
2024/11/07 01:18:43 INFO  : Path1:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:43 INFO  : Path2 checking for diffs
2024/11/07 01:18:43 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1/". Run with --force if desired.
2024/11/07 01:18:43 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:18:43 NOTICE: Bisync error: too many deletes
2024/11/07 01:18:43 NOTICE: (12)  : copy-listings initial-fail
2024/11/07 01:18:43 NOTICE: (13)  : test change max-delete limit to 60%. sync should run.
2024/11/07 01:18:43 NOTICE: (14)  : bisync max-delete=60
2024/11/07 01:18:43 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:43 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:43 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1/" with Path2 "/tmp/011836si/max_delete_path1/path2/"
2024/11/07 01:18:43 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:43 INFO  : Path1 checking for diffs
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file1.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file2.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file3.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:43 INFO  : - Path1    File was deleted          - file5.txt
2024/11/07 01:18:43 INFO  : Path1:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:43 INFO  : Path2 checking for diffs
2024/11/07 01:18:43 INFO  : Applying changes
2024/11/07 01:18:43 INFO  : - Path2    Queue delete              - /tmp/011836si/max_delete_path1/path2/file1.txt
2024/11/07 01:18:43 INFO  : - Path2    Queue delete              - /tmp/011836si/max_delete_path1/path2/file2.txt
2024/11/07 01:18:43 INFO  : - Path2    Queue delete              - /tmp/011836si/max_delete_path1/path2/file3.txt
2024/11/07 01:18:43 INFO  : - Path2    Queue delete              - /tmp/011836si/max_delete_path1/path2/file4.txt
2024/11/07 01:18:43 INFO  : - Path2    Queue delete              - /tmp/011836si/max_delete_path1/path2/file5.txt
2024/11/07 01:18:43 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:43 INFO  : file2.txt: Deleted
2024/11/07 01:18:43 INFO  : file3.txt: Deleted
2024/11/07 01:18:43 INFO  : file4.txt: Deleted
2024/11/07 01:18:43 INFO  : file5.txt: Deleted
2024/11/07 01:18:43 INFO  : file1.txt: Deleted
2024/11/07 01:18:43 INFO  : Updating listings
2024/11/07 01:18:43 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path1/path1/" vs Path2 "/tmp/011836si/max_delete_path1/path2/"
2024/11/07 01:18:43 INFO  : Bisync successful
    bisync_test.go:558: TEST max_delete_path1 PASSED
=== RUN   TestBisyncRemoteLocal/max_delete_path2_force
2024/11/07 01:18:43 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:43 DEBUG : path1: Making directory
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:43 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1"
2024/11/07 01:18:43 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:43 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:43 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:43 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:43 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/max_delete_path2_force/path2"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path2_force/initial"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_max_delete_path2_force-qebejel1"
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/initdir/test_max_delete_path2_force-qebejel1: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/initdir/test_max_delete_path2_force-qebejel1: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:43 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:43 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:43 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:43 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:43 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:43 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:43 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:43 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:43 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:43 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_max_delete_path2_force/modfiles"
2024/11/07 01:18:43 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_max_delete_path2_force-dotuqiq0"
2024/11/07 01:18:43 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/datadir/test_max_delete_path2_force-dotuqiq0: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : Local file system at /tmp/011836si/datadir/test_max_delete_path2_force-dotuqiq0: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:43 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:43 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: list [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1]
2024/11/07 01:18:43 ERROR : : error listing: directory not found
2024/11/07 01:18:43 ERROR : : error listing: directory not found
2024/11/07 01:18:43 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_max_delete_path2_force-qebejel1
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: list [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1]
2024/11/07 01:18:43 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: Waiting for checks to finish
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: Waiting for transfers to finish
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file1.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file2.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file3.txt]
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file4.txt]
2024/11/07 01:18:43 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file5.txt]
2024/11/07 01:18:43 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file6.txt]
2024/11/07 01:18:43 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file7.txt]
2024/11/07 01:18:43 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file8.txt]
2024/11/07 01:18:43 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:43 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: update [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file9.txt]
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:44 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1: list [/rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1]
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/max_delete_path2_force/path2: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/max_delete_path2_force/path2: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:44 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:44 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:44 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:44 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:44 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:44 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:44 NOTICE: checking path2 Local file system at /tmp/011836si/max_delete_path2_force/path2
2024/11/07 01:18:44 NOTICE: (01)  : test max-delete-path2-force
2024/11/07 01:18:44 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:44 NOTICE: (03)  : bisync resync
2024/11/07 01:18:44 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:44 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:44 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/" with Path2 "/tmp/011836si/max_delete_path2_force/path2/"
2024/11/07 01:18:44 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:44 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:44 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:44 INFO  : Resync updating listings
2024/11/07 01:18:44 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/" vs Path2 "/tmp/011836si/max_delete_path2_force/path2/"
2024/11/07 01:18:44 INFO  : Bisync successful
2024/11/07 01:18:44 NOTICE: (04)  : test delete >50% of remote files
2024/11/07 01:18:44 NOTICE: (05)  : delete-file /tmp/011836si/max_delete_path2_force/path2/file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Deleted
2024/11/07 01:18:44 NOTICE: (06)  : delete-file /tmp/011836si/max_delete_path2_force/path2/file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Deleted
2024/11/07 01:18:44 NOTICE: (07)  : delete-file /tmp/011836si/max_delete_path2_force/path2/file3.txt
2024/11/07 01:18:44 INFO  : file3.txt: Deleted
2024/11/07 01:18:44 NOTICE: (08)  : delete-file /tmp/011836si/max_delete_path2_force/path2/file4.txt
2024/11/07 01:18:44 INFO  : file4.txt: Deleted
2024/11/07 01:18:44 NOTICE: (09)  : delete-file /tmp/011836si/max_delete_path2_force/path2/file5.txt
2024/11/07 01:18:44 INFO  : file5.txt: Deleted
2024/11/07 01:18:44 NOTICE: (10)  : test sync should fail due to too many path2 deletes
2024/11/07 01:18:44 NOTICE: (11)  : bisync
2024/11/07 01:18:44 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:44 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:44 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/" with Path2 "/tmp/011836si/max_delete_path2_force/path2/"
2024/11/07 01:18:44 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:44 INFO  : Path1 checking for diffs
2024/11/07 01:18:44 INFO  : Path2 checking for diffs
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file1.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file2.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file4.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file5.txt
2024/11/07 01:18:44 INFO  : Path2:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:44 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "/tmp/011836si/max_delete_path2_force/path2/". Run with --force if desired.
2024/11/07 01:18:44 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:18:44 NOTICE: Bisync error: too many deletes
2024/11/07 01:18:44 NOTICE: (12)  : copy-listings initial-fail
2024/11/07 01:18:44 NOTICE: (13)  : test apply force option. sync should run.
2024/11/07 01:18:44 NOTICE: (14)  : bisync force
2024/11/07 01:18:44 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:44 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:44 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/" with Path2 "/tmp/011836si/max_delete_path2_force/path2/"
2024/11/07 01:18:44 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:44 INFO  : Path1 checking for diffs
2024/11/07 01:18:44 INFO  : Path2 checking for diffs
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file1.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file2.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file4.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file5.txt
2024/11/07 01:18:44 INFO  : Path2:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:44 INFO  : Applying changes
2024/11/07 01:18:44 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file1.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file2.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file3.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file4.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/file5.txt
2024/11/07 01:18:44 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:44 INFO  : file1.txt: Deleted
2024/11/07 01:18:44 INFO  : file2.txt: Deleted
2024/11/07 01:18:44 INFO  : file5.txt: Deleted
2024/11/07 01:18:44 INFO  : file4.txt: Deleted
2024/11/07 01:18:44 INFO  : file3.txt: Deleted
2024/11/07 01:18:44 INFO  : Updating listings
2024/11/07 01:18:44 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/max_delete_path2_force/path1/" vs Path2 "/tmp/011836si/max_delete_path2_force/path2/"
2024/11/07 01:18:44 INFO  : Bisync successful
    bisync_test.go:558: TEST max_delete_path2_force PASSED
=== RUN   TestBisyncRemoteLocal/nomodtime
2024/11/07 01:18:44 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:44 DEBUG : path1: Making directory
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:44 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/nomodtime/path1"
2024/11/07 01:18:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:44 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/nomodtime/path2"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/initial"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_nomodtime-yuqifem4"
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/initdir/test_nomodtime-yuqifem4: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/initdir/test_nomodtime-yuqifem4: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:44 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:44 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:44 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:44 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:44 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_nomodtime/modfiles"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_nomodtime-larezuj3"
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/datadir/test_nomodtime-larezuj3: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/datadir/test_nomodtime-larezuj3: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt
2024/11/07 01:18:44 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt
2024/11/07 01:18:44 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:44 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:44 DEBUG : file5L.txt.9ed658ed.partial: renamed to: file5L.txt
2024/11/07 01:18:44 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:44 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file5R.txt.9ed658ed.partial: renamed to: file5R.txt
2024/11/07 01:18:44 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: list [/rclone-test-jisagow5dego/011836si/nomodtime/path1]
2024/11/07 01:18:44 ERROR : : error listing: directory not found
2024/11/07 01:18:44 ERROR : : error listing: directory not found
2024/11/07 01:18:44 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_nomodtime-yuqifem4
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: list [/rclone-test-jisagow5dego/011836si/nomodtime/path1]
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/RCLONE_TEST]
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file1.txt]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file2.txt]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file3.txt]
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file4.txt]
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file5.txt]
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file6.txt]
2024/11/07 01:18:44 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file7.txt]
2024/11/07 01:18:44 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: update [/rclone-test-jisagow5dego/011836si/nomodtime/path1/file8.txt]
2024/11/07 01:18:44 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:44 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/nomodtime/path1: list [/rclone-test-jisagow5dego/011836si/nomodtime/path1]
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:44 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:44 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:44 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/nomodtime/path2: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/nomodtime/path2: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:44 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:44 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 NOTICE: checking path2 Local file system at /tmp/011836si/nomodtime/path2
2024/11/07 01:18:44 NOTICE: (01)  : test changes
2024/11/07 01:18:44 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:44 NOTICE: (03)  : bisync resync nomodtime
2024/11/07 01:18:44 NOTICE: Local file system at /tmp/011836si/nomodtime/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:44 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:44 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/" with Path2 "/tmp/011836si/nomodtime/path2/"
2024/11/07 01:18:44 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:44 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:44 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:44 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:44 INFO  : Resync updating listings
2024/11/07 01:18:44 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/" vs Path2 "/tmp/011836si/nomodtime/path2/"
2024/11/07 01:18:44 INFO  : Bisync successful
2024/11/07 01:18:44 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:18:44 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:18:44 NOTICE: (06)  : copy-file /tmp/011836si/datadir/test_nomodtime-larezuj3/file10.txt /tmp/011836si/nomodtime/path2/
2024/11/07 01:18:44 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:44 NOTICE: (07)  : test changed on path2 - file1
2024/11/07 01:18:44 NOTICE: (08)  : copy-file /tmp/011836si/datadir/test_nomodtime-larezuj3/file1.txt /tmp/011836si/nomodtime/path2/
2024/11/07 01:18:44 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:44 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:18:44 NOTICE: (10)  : copy-file /tmp/011836si/datadir/test_nomodtime-larezuj3/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/
2024/11/07 01:18:44 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:44 NOTICE: (11)  : test changed on path1 - file2
2024/11/07 01:18:44 NOTICE: (12)  : copy-file /tmp/011836si/datadir/test_nomodtime-larezuj3/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/
2024/11/07 01:18:44 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:44 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:18:44 NOTICE: (14)  : delete-file /tmp/011836si/nomodtime/path2/file3.txt
2024/11/07 01:18:44 INFO  : file3.txt: Deleted
2024/11/07 01:18:44 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:18:44 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/file4.txt
2024/11/07 01:18:44 INFO  : file4.txt: Deleted
2024/11/07 01:18:44 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:18:44 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/file8.txt
2024/11/07 01:18:44 INFO  : file8.txt: Deleted
2024/11/07 01:18:44 NOTICE: (19)  : delete-file /tmp/011836si/nomodtime/path2/file8.txt
2024/11/07 01:18:44 INFO  : file8.txt: Deleted
2024/11/07 01:18:44 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:18:44 NOTICE: (21)  : copy-as /tmp/011836si/datadir/test_nomodtime-larezuj3/file5R.txt /tmp/011836si/nomodtime/path2/ file5.txt
2024/11/07 01:18:44 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:44 NOTICE: (22)  : copy-as /tmp/011836si/datadir/test_nomodtime-larezuj3/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/ file5.txt
2024/11/07 01:18:44 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:44 NOTICE: (23)  : test changed on path2 and deleted on path1 - file6
2024/11/07 01:18:44 NOTICE: (24)  : copy-file /tmp/011836si/datadir/test_nomodtime-larezuj3/file6.txt /tmp/011836si/nomodtime/path2/
2024/11/07 01:18:44 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:44 NOTICE: (25)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/file6.txt
2024/11/07 01:18:44 INFO  : file6.txt: Deleted
2024/11/07 01:18:44 NOTICE: (26)  : test changed on path1 and deleted on path2 - file7
2024/11/07 01:18:44 NOTICE: (27)  : copy-file /tmp/011836si/datadir/test_nomodtime-larezuj3/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/nomodtime/path1/
2024/11/07 01:18:44 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:44 NOTICE: (28)  : delete-file /tmp/011836si/nomodtime/path2/file7.txt
2024/11/07 01:18:44 INFO  : file7.txt: Deleted
2024/11/07 01:18:44 NOTICE: (29)  : test bisync run
2024/11/07 01:18:44 NOTICE: (30)  : bisync nomodtime
2024/11/07 01:18:44 NOTICE: Local file system at /tmp/011836si/nomodtime/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:44 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:44 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/" with Path2 "/tmp/011836si/nomodtime/path2/"
2024/11/07 01:18:44 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:44 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:44 INFO  : Path1 checking for diffs
2024/11/07 01:18:44 INFO  : - Path1    File changed: size (larger), hash - file2.txt
2024/11/07 01:18:44 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:44 INFO  : - Path1    File changed: size (larger), hash - file5.txt
2024/11/07 01:18:44 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:44 INFO  : - Path1    File changed: size (larger), hash - file7.txt
2024/11/07 01:18:44 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:18:44 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:44 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:44 INFO  : (Modified:    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:44 INFO  : Path2 checking for diffs
2024/11/07 01:18:44 INFO  : - Path2    File changed: size (larger), hash - file1.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:44 INFO  : - Path2    File changed: size (larger), hash - file5.txt
2024/11/07 01:18:44 INFO  : - Path2    File changed: size (larger), hash - file6.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:44 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:18:44 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:44 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:44 INFO  : (Modified:    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:44 INFO  : Applying changes
2024/11/07 01:18:44 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/nomodtime/path2/file11.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/nomodtime/path2/file2.txt
2024/11/07 01:18:44 INFO  : - Path2    Queue delete              - /tmp/011836si/nomodtime/path2/file4.txt
2024/11/07 01:18:44 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:44 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/file5.txt.conflict1
2024/11/07 01:18:44 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:44 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/nomodtime/path2/file5.txt.conflict1
2024/11/07 01:18:44 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/nomodtime/path2/file5.txt.conflict2
2024/11/07 01:18:44 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:44 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/file5.txt.conflict2
2024/11/07 01:18:44 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/file6.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/nomodtime/path2/file7.txt
2024/11/07 01:18:44 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/file1.txt
2024/11/07 01:18:44 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/file10.txt
2024/11/07 01:18:44 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/file3.txt
2024/11/07 01:18:44 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:44 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:44 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:44 INFO  : file3.txt: Deleted
2024/11/07 01:18:44 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:44 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:44 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:44 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:44 INFO  : file4.txt: Deleted
2024/11/07 01:18:44 INFO  : Updating listings
2024/11/07 01:18:44 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/nomodtime/path1/" vs Path2 "/tmp/011836si/nomodtime/path2/"
2024/11/07 01:18:44 INFO  : Bisync successful
    bisync_test.go:558: TEST nomodtime PASSED
=== RUN   TestBisyncRemoteLocal/normalization
2024/11/07 01:18:44 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:44 DEBUG : path1: Making directory
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:44 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/normalization/path1"
2024/11/07 01:18:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:44 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/normalization/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/normalization/path1"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/normalization/path2"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_normalization/initial"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_normalization-vaguxam8"
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory with metadata
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:44 DEBUG : Added delayed dir = "測試_Ру��кий_ _ _ě_áñ", newDst=測試_Ру��кий_ _ _ě_áñ
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:44 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/initdir/test_normalization-vaguxam8: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/initdir/test_normalization-vaguxam8: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file.5028a97.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/測試_check file
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_normalization/modfiles"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_normalization-pibafol8"
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/datadir/test_normalization-pibafol8: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/datadir/test_normalization-pibafol8: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:18:44 DEBUG : 測試_filtersfile.txt.e8d47346.partial: renamed to: 測試_filtersfile.txt
2024/11/07 01:18:44 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: list [/rclone-test-jisagow5dego/011836si/normalization/path1]
2024/11/07 01:18:44 ERROR : : error listing: directory not found
2024/11/07 01:18:44 ERROR : : error listing: directory not found
2024/11/07 01:18:44 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_normalization-vaguxam8
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: list [/rclone-test-jisagow5dego/011836si/normalization/path1]
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: mkdir [/rclone-test-jisagow5dego/011836si/normalization/path1/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: update [/rclone-test-jisagow5dego/011836si/normalization/path1/RCLONE_TEST]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: update [/rclone-test-jisagow5dego/011836si/normalization/path1/file1.txt]
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: update [/rclone-test-jisagow5dego/011836si/normalization/path1/測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: update [/rclone-test-jisagow5dego/011836si/normalization/path1/測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: Waiting for transfers to finish
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: update [/rclone-test-jisagow5dego/011836si/normalization/path1/測試_Ру��кий_ _ _ě_áñ/測試_check file]
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:44 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: list [/rclone-test-jisagow5dego/011836si/normalization/path1]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1: list [/rclone-test-jisagow5dego/011836si/normalization/path1/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory with metadata
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:44 DEBUG : Added delayed dir = "測試_Ру��кий_ _ _ě_áñ", newDst=測試_Ру��кий_ _ _ě_áñ
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/normalization/path2: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/normalization/path2: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file.5028a97.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/測試_check file
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:44 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:44 INFO  : 測試_Ру��кий_ _ _ě_áñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:44 NOTICE: checking path2 Local file system at /tmp/011836si/normalization/path2
2024/11/07 01:18:44 NOTICE: (01)  : test normalization
2024/11/07 01:18:44 NOTICE: (02)  : touch-copy 2001-01-02 /tmp/011836si/datadir/test_normalization-pibafol8/file1.txt /tmp/011836si/normalization/path2/
2024/11/07 01:18:44 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:44 NOTICE: (03)  : test initial bisync
2024/11/07 01:18:44 NOTICE: (04)  : bisync resync
2024/11/07 01:18:44 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:44 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:18:44 NOTICE: Local file system at /tmp/011836si/normalization/path2: Replacing invalid UTF-8 characters in "ě\x81\xfe a�ñhࢺ_測試Ру�кийěa�ñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬e�ö"
2024/11/07 01:18:44 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:44 NOTICE: Local file system at /tmp/011836si/normalization/path2: Replacing invalid UTF-8 characters in "ě\x81\xfe áñhࢺ_測試Ру�кийěáñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö"
2024/11/07 01:18:44 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
    bisync_test.go:1024: Fs is incapable of running test as the paths produce different results, skipping: normalization (path1: 
        測試_РуÑ�Ñ�кий_ _ _Ä›_áñě�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö (NFC) path2: 
        測試_Ру��кий_ _ _ě_áñ測試_Ру��кий_ _ _ě_áñ (測試_Ру��кий_ _ _ě_áñ測試_Ру��кий_ _ _ě_áñ))
         (fs1: hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/normalization/path1 fs2: Local file system at /tmp/011836si/normalization/path2) 
        @@ -1 +1 @@
        -測試_РуÑ�Ñ�кий_ _ _Ä›_áñě�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö+測試_РуÑ�Ñ�кий_ _ _Ä›_áñ測試_РуÑ�Ñ�кий_ _ _Ä›_áñ
=== RUN   TestBisyncRemoteLocal/rclone_args
2024/11/07 01:18:44 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:44 DEBUG : path1: Making directory
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:44 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/rclone_args/path1"
2024/11/07 01:18:44 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:44 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:44 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:44 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:44 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/rclone_args/path2"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/initial"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_rclone_args-cobivay3"
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:44 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:44 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:44 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/initdir/test_rclone_args-cobivay3: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/initdir/test_rclone_args-cobivay3: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:44 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt
2024/11/07 01:18:44 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK
2024/11/07 01:18:44 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:44 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:44 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:44 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rclone_args/modfiles"
2024/11/07 01:18:44 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_rclone_args-mibogap1"
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file20.txt.b4075ff1.partial: renamed to: file20.txt
2024/11/07 01:18:44 INFO  : file20.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:44 DEBUG : file21.txt.b4075ff1.partial: renamed to: file21.txt
2024/11/07 01:18:44 INFO  : file21.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/datadir/test_rclone_args-mibogap1: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : Local file system at /tmp/011836si/datadir/test_rclone_args-mibogap1: Waiting for transfers to finish
2024/11/07 01:18:44 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file2.txt.6bedbe24.partial: renamed to: file2.txt
2024/11/07 01:18:44 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:44 DEBUG : file1.txt.6bedbe24.partial: renamed to: file1.txt
2024/11/07 01:18:44 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: list [/rclone-test-jisagow5dego/011836si/rclone_args/path1]
2024/11/07 01:18:44 ERROR : : error listing: directory not found
2024/11/07 01:18:44 ERROR : : error listing: directory not found
2024/11/07 01:18:44 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_rclone_args-cobivay3
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: list [/rclone-test-jisagow5dego/011836si/rclone_args/path1]
2024/11/07 01:18:44 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: update [/rclone-test-jisagow5dego/011836si/rclone_args/path1/RCLONE_TEST]
2024/11/07 01:18:44 DEBUG : subdir: Making directory
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: mkdir [/rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: update [/rclone-test-jisagow5dego/011836si/rclone_args/path1/file1.txt]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: update [/rclone-test-jisagow5dego/011836si/rclone_args/path1/file2.txt]
2024/11/07 01:18:44 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: update [/rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/file20.txt]
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: Waiting for checks to finish
2024/11/07 01:18:44 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: Waiting for transfers to finish
2024/11/07 01:18:45 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-jisagow5dego/011836si/rclone_args/path1/RCLONE_TEST: replication in progress)
2024/11/07 01:18:45 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2024/11/07 01:18:45 DEBUG : pacer: Reducing sleep to 30ms
2024/11/07 01:18:45 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: update [/rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/file21.txt]
2024/11/07 01:18:45 DEBUG : pacer: Reducing sleep to 22.5ms
2024/11/07 01:18:45 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : pacer: Reducing sleep to 20ms
2024/11/07 01:18:45 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:18:45 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: list [/rclone-test-jisagow5dego/011836si/rclone_args/path1]
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rclone_args/path1: list [/rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir]
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:45 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:45 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:45 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK
2024/11/07 01:18:45 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:45 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/rclone_args/path2: Waiting for checks to finish
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/rclone_args/path2: Waiting for transfers to finish
2024/11/07 01:18:45 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:45 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt
2024/11/07 01:18:45 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:45 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 NOTICE: checking path2 Local file system at /tmp/011836si/rclone_args/path2
2024/11/07 01:18:45 NOTICE: (01)  : test rclone-args
2024/11/07 01:18:45 NOTICE: (02)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_rclone_args-mibogap1/ *
2024/11/07 01:18:45 NOTICE: (03)  : test initial bisync
2024/11/07 01:18:45 NOTICE: (04)  : bisync resync checksum
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/rclone_args/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:45 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:45 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:45 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:45 INFO  : Resync updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (05)  : test place newer files on both paths
2024/11/07 01:18:45 NOTICE: (06)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (07)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file2.txt /tmp/011836si/rclone_args/path2/
2024/11/07 01:18:45 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (08)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir
2024/11/07 01:18:45 INFO  : file20.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (09)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file21.txt /tmp/011836si/rclone_args/path2/subdir
2024/11/07 01:18:45 INFO  : file21.txt: Updated modification time in destination
2024/11/07 01:18:45 NOTICE: (10)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/ file1.txt
2024/11/07 01:18:45 NOTICE: (11)  : touch-glob 2001-01-02 /tmp/011836si/rclone_args/path2/ file2.txt
2024/11/07 01:18:45 NOTICE: (12)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:45 NOTICE: (13)  : touch-glob 2001-01-02 /tmp/011836si/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:45 NOTICE: (14)  : test run bisync with custom options
2024/11/07 01:18:45 NOTICE: (15)  : bisync checksum
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/rclone_args/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : - Path1    File changed: hash - file1.txt
2024/11/07 01:18:45 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 hash differs)
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File changed: size (larger), hash - file2.txt
2024/11/07 01:18:45 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 larger,    0 smaller,    1 hash differs)
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/rclone_args/path2/file1.txt
2024/11/07 01:18:45 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/file2.txt
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:45 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (16)  : touch-glob 2007-07-23 /tmp/011836si/datadir/test_rclone_args-mibogap1/ *
2024/11/07 01:18:45 NOTICE: (17)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (18)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file2.txt /tmp/011836si/rclone_args/path2/
2024/11/07 01:18:45 INFO  : file2.txt: Updated modification time in destination
2024/11/07 01:18:45 NOTICE: (19)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir
2024/11/07 01:18:45 INFO  : file20.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (20)  : copy-as /tmp/011836si/datadir/test_rclone_args-mibogap1/file21.txt /tmp/011836si/rclone_args/path2/ file1.txt
2024/11/07 01:18:45 INFO  : file21.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:45 NOTICE: (21)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/ file1.txt
2024/11/07 01:18:45 NOTICE: (22)  : touch-glob 2007-07-23 /tmp/011836si/rclone_args/path2/ file2.txt
2024/11/07 01:18:45 NOTICE: (23)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:45 NOTICE: (24)  : touch-glob 2007-07-23 /tmp/011836si/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:45 NOTICE: (25)  : bisync size-only
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File changed: size (smaller) - file1.txt
2024/11/07 01:18:45 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    0 larger,    1 smaller)
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/file1.txt
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (26)  : bisync resync
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:45 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:45 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:45 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 INFO  : Resync updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (27)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (28)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file2.txt /tmp/011836si/rclone_args/path2/
2024/11/07 01:18:45 INFO  : file2.txt: Updated modification time in destination
2024/11/07 01:18:45 NOTICE: (29)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir
2024/11/07 01:18:45 NOTICE: (30)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file21.txt /tmp/011836si/rclone_args/path2/subdir
2024/11/07 01:18:45 INFO  : file21.txt: Updated modification time in destination
2024/11/07 01:18:45 NOTICE: (31)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/ file1.txt
2024/11/07 01:18:45 NOTICE: (32)  : touch-glob 2007-07-23 /tmp/011836si/rclone_args/path2/ file2.txt
2024/11/07 01:18:45 NOTICE: (33)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:45 NOTICE: (34)  : touch-glob 2007-07-23 /tmp/011836si/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:45 NOTICE: (35)  : bisync ignore-size
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": false,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File changed: time (newer) - file2.txt
2024/11/07 01:18:45 INFO  : - Path2    File changed: time (newer) - subdir/file21.txt
2024/11/07 01:18:45 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    2 newer,    0 older)
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/file2.txt
2024/11/07 01:18:45 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/file21.txt
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:45 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (36)  : bisync resync compare-all
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/rclone_args/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:45 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:45 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:45 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : Resync updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (37)  : copy-as /tmp/011836si/datadir/test_rclone_args-mibogap1/file21.txt /tmp/011836si/rclone_args/path2/ file2.txt
2024/11/07 01:18:45 INFO  : file21.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:45 NOTICE: (38)  : touch-glob 2023-08-26 /tmp/011836si/datadir/test_rclone_args-mibogap1/ *
2024/11/07 01:18:45 NOTICE: (39)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (40)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir
2024/11/07 01:18:45 INFO  : file20.txt: Copied (replaced existing)
2024/11/07 01:18:45 NOTICE: (41)  : copy-file /tmp/011836si/datadir/test_rclone_args-mibogap1/file21.txt /tmp/011836si/rclone_args/path2/subdir
2024/11/07 01:18:45 INFO  : file21.txt: Updated modification time in destination
2024/11/07 01:18:45 NOTICE: (42)  : touch-glob 2007-07-23 /tmp/011836si/rclone_args/path2/ file2.txt
2024/11/07 01:18:45 NOTICE: (43)  : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/ file1.txt
2024/11/07 01:18:45 NOTICE: (44)  : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:45 NOTICE: (45)  : touch-glob 2023-08-26 /tmp/011836si/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:45 NOTICE: (46)  : bisync compare-all
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/rclone_args/path2: will use md5 for same-side diffs on Path2 only
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 1,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" with Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:18:45 INFO  : - Path1    File changed: time (newer) - subdir/file20.txt
2024/11/07 01:18:45 INFO  : Path1:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    2 newer,    0 older)
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File changed: size (smaller), hash - file2.txt
2024/11/07 01:18:45 INFO  : - Path2    File changed: time (newer) - subdir/file21.txt
2024/11/07 01:18:45 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 newer,    0 older,    0 larger,    1 smaller,    1 hash differs)
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/rclone_args/path2/file1.txt
2024/11/07 01:18:45 INFO  : - Path1    Queue copy to Path2       - /tmp/011836si/rclone_args/path2/subdir/file20.txt
2024/11/07 01:18:45 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/file2.txt
2024/11/07 01:18:45 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/subdir/file21.txt
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:45 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:45 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:45 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rclone_args/path1/" vs Path2 "/tmp/011836si/rclone_args/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
    bisync_test.go:558: TEST rclone_args PASSED
=== RUN   TestBisyncRemoteLocal/resolve
2024/11/07 01:18:45 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:45 DEBUG : path1: Making directory
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:45 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/resolve/path1"
2024/11/07 01:18:45 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:45 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:45 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:45 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:45 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/resolve/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1"
2024/11/07 01:18:45 DEBUG : Creating backend with remote "/tmp/011836si/resolve/path2"
2024/11/07 01:18:45 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resolve/initial"
2024/11/07 01:18:45 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_resolve-buhiyoj4"
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:45 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/initdir/test_resolve-buhiyoj4: Waiting for checks to finish
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/initdir/test_resolve-buhiyoj4: Waiting for transfers to finish
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:45 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:45 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:45 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resolve/modfiles"
2024/11/07 01:18:45 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_resolve-guripip3"
2024/11/07 01:18:45 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/datadir/test_resolve-guripip3: Waiting for checks to finish
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/datadir/test_resolve-guripip3: Waiting for transfers to finish
2024/11/07 01:18:45 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:18:45 DEBUG : file1L.txt.711f2f3a.partial: renamed to: file1L.txt
2024/11/07 01:18:45 INFO  : file1L.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:18:45 DEBUG : file2.txt.cc713425.partial: renamed to: file2.txt
2024/11/07 01:18:45 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK
2024/11/07 01:18:45 DEBUG : file1R.txt.eafd8cfe.partial: renamed to: file1R.txt
2024/11/07 01:18:45 INFO  : file1R.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: list [/rclone-test-jisagow5dego/011836si/resolve/path1]
2024/11/07 01:18:45 ERROR : : error listing: directory not found
2024/11/07 01:18:45 ERROR : : error listing: directory not found
2024/11/07 01:18:45 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_resolve-buhiyoj4
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: list [/rclone-test-jisagow5dego/011836si/resolve/path1]
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: Waiting for checks to finish
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: update [/rclone-test-jisagow5dego/011836si/resolve/path1/RCLONE_TEST]
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: update [/rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt]
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: Waiting for transfers to finish
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: update [/rclone-test-jisagow5dego/011836si/resolve/path1/file2.txt]
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:45 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:45 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1
2024/11/07 01:18:45 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resolve/path1: list [/rclone-test-jisagow5dego/011836si/resolve/path1]
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/resolve/path2: Waiting for checks to finish
2024/11/07 01:18:45 DEBUG : Local file system at /tmp/011836si/resolve/path2: Waiting for transfers to finish
2024/11/07 01:18:45 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:45 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:45 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:45 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:45 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:45 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:45 NOTICE: checking path2 Local file system at /tmp/011836si/resolve/path2
2024/11/07 01:18:45 NOTICE: (01)  : test resolve
2024/11/07 01:18:45 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:45 NOTICE: (03)  : bisync resync
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:45 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:45 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:45 INFO  : Resync updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (04)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:45 NOTICE: (05)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_resolve-guripip3/ file1R.txt
2024/11/07 01:18:45 NOTICE: (06)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt /tmp/011836si/resolve/path2/ file1.txt
2024/11/07 01:18:45 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:45 NOTICE: (07)  : touch-glob 2001-03-04 /tmp/011836si/datadir/test_resolve-guripip3/ file1L.txt
2024/11/07 01:18:45 NOTICE: (08)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file1.txt
2024/11/07 01:18:45 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:45 NOTICE: (09)  : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato
2024/11/07 01:18:45 NOTICE: (10)  : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : - Path1    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:45 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:45 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:45 INFO  : Checking potential conflicts...
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 differences found
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 errors while checking
2024/11/07 01:18:45 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:45 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s
2024/11/07 01:18:45 INFO  : file1.txt: The winner is: Path1
2024/11/07 01:18:45 NOTICE: - Path2    Deleting Path2 copy                - /tmp/011836si/resolve/path2/file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: Deleted
2024/11/07 01:18:45 INFO  : - Path1    Queue copy to Path2       - file1.txt
2024/11/07 01:18:45 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (11)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:45 NOTICE: (12)  : touch-glob 2001-07-23 /tmp/011836si/datadir/test_resolve-guripip3/ file1R.txt
2024/11/07 01:18:45 NOTICE: (13)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt /tmp/011836si/resolve/path2/ file1.txt
2024/11/07 01:18:45 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:45 NOTICE: (14)  : touch-glob 2001-08-26 /tmp/011836si/datadir/test_resolve-guripip3/ file1L.txt
2024/11/07 01:18:45 NOTICE: (15)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file1.txt
2024/11/07 01:18:45 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:45 NOTICE: (16)  : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur
2024/11/07 01:18:45 NOTICE: (17)  : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:18:45 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File changed: time (newer) - file1.txt
2024/11/07 01:18:45 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:45 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:45 INFO  : Checking potential conflicts...
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 differences found
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 errors while checking
2024/11/07 01:18:45 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:45 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: The winner is: Path2
2024/11/07 01:18:45 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt.dinosaur1
2024/11/07 01:18:45 INFO  : file1.txt: Moved (server-side) to: file1.txt.dinosaur1
2024/11/07 01:18:45 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/resolve/path2/file1.txt.dinosaur1
2024/11/07 01:18:45 NOTICE: - Path2    Not renaming Path2 copy, as it was determined the winner - /tmp/011836si/resolve/path2/file1.txt
2024/11/07 01:18:45 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:45 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:45 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:45 INFO  : file1.txt.dinosaur1: Copied (new)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (18)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:45 NOTICE: (19)  : touch-glob 2002-07-23 /tmp/011836si/datadir/test_resolve-guripip3/ file1R.txt
2024/11/07 01:18:45 NOTICE: (20)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt /tmp/011836si/resolve/path2/ file1.txt
2024/11/07 01:18:45 INFO  : file1R.txt: Updated modification time in destination
2024/11/07 01:18:45 NOTICE: (21)  : touch-glob 2002-08-26 /tmp/011836si/datadir/test_resolve-guripip3/ file1L.txt
2024/11/07 01:18:45 NOTICE: (22)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file1.txt
2024/11/07 01:18:45 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:45 NOTICE: (23)  : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple
2024/11/07 01:18:45 NOTICE: (24)  : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:45 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:45 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:45 INFO  : Checking potential conflicts...
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 differences found
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 errors while checking
2024/11/07 01:18:45 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:45 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0
2024/11/07 01:18:45 INFO  : file1.txt: A winner could not be determined.
2024/11/07 01:18:45 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt.apple1
2024/11/07 01:18:45 INFO  : file1.txt: Moved (server-side) to: file1.txt.apple1
2024/11/07 01:18:45 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/resolve/path2/file1.txt.apple1
2024/11/07 01:18:45 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/resolve/path2/file1.txt.apple2
2024/11/07 01:18:45 INFO  : file1.txt: Moved (server-side) to: file1.txt.apple2
2024/11/07 01:18:45 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt.apple2
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:45 INFO  : file1.txt.apple2: Copied (new)
2024/11/07 01:18:45 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:45 INFO  : file1.txt.apple1: Copied (new)
2024/11/07 01:18:45 INFO  : Updating listings
2024/11/07 01:18:45 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Bisync successful
2024/11/07 01:18:45 NOTICE: (25)  : test different suffixes
2024/11/07 01:18:45 NOTICE: (26)  : touch-glob 2003-07-23 /tmp/011836si/datadir/test_resolve-guripip3/ file1R.txt
2024/11/07 01:18:45 NOTICE: (27)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt /tmp/011836si/resolve/path2/ file1.txt
2024/11/07 01:18:45 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:18:45 NOTICE: (28)  : touch-glob 2003-07-23 /tmp/011836si/datadir/test_resolve-guripip3/ file1L.txt
2024/11/07 01:18:45 NOTICE: (29)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file1.txt
2024/11/07 01:18:45 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:18:45 NOTICE: (30)  : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local
2024/11/07 01:18:45 NOTICE: (31)  : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local
2024/11/07 01:18:45 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:45 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:45 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:45 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:45 INFO  : Path1 checking for diffs
2024/11/07 01:18:45 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:45 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:45 INFO  : Path2 checking for diffs
2024/11/07 01:18:45 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:45 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:45 INFO  : Applying changes
2024/11/07 01:18:45 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:45 INFO  : Checking potential conflicts...
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 differences found
2024/11/07 01:18:45 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 errors while checking
2024/11/07 01:18:45 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:45 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:45 INFO  : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s
2024/11/07 01:18:45 INFO  : file1.txt: A winner could not be determined.
2024/11/07 01:18:45 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt.cloud1
2024/11/07 01:18:45 INFO  : file1.txt: Moved (server-side) to: file1.txt.cloud1
2024/11/07 01:18:45 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/resolve/path2/file1.txt.cloud1
2024/11/07 01:18:45 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/resolve/path2/file1.txt.local1
2024/11/07 01:18:45 INFO  : file1.txt: Moved (server-side) to: file1.txt.local1
2024/11/07 01:18:45 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt.local1
2024/11/07 01:18:45 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:46 INFO  : file1.txt.local1: Copied (new)
2024/11/07 01:18:46 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:46 INFO  : file1.txt.cloud1: Copied (new)
2024/11/07 01:18:46 INFO  : Updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (32)  : test legacy
2024/11/07 01:18:46 NOTICE: (33)  : touch-glob 2004-07-23 /tmp/011836si/datadir/test_resolve-guripip3/ file1R.txt
2024/11/07 01:18:46 NOTICE: (34)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt /tmp/011836si/resolve/path2/ file1.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:18:46 NOTICE: (35)  : touch-glob 2004-07-23 /tmp/011836si/datadir/test_resolve-guripip3/ file1L.txt
2024/11/07 01:18:46 NOTICE: (36)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file1.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:18:46 NOTICE: (37)  : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path
2024/11/07 01:18:46 NOTICE: (38)  : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:46 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:46 INFO  : Path1 checking for diffs
2024/11/07 01:18:46 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:46 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:46 INFO  : Path2 checking for diffs
2024/11/07 01:18:46 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:46 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:46 INFO  : Applying changes
2024/11/07 01:18:46 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:46 INFO  : Checking potential conflicts...
2024/11/07 01:18:46 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 differences found
2024/11/07 01:18:46 NOTICE: Local file system at /tmp/011836si/resolve/path2: 1 errors while checking
2024/11/07 01:18:46 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:46 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:46 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt..path1
2024/11/07 01:18:46 INFO  : file1.txt: Moved (server-side) to: file1.txt..path1
2024/11/07 01:18:46 NOTICE: - Path1    Queue copy to Path2       - /tmp/011836si/resolve/path2/file1.txt..path1
2024/11/07 01:18:46 NOTICE: - Path2    Renaming Path2 copy                - /tmp/011836si/resolve/path2/file1.txt..path2
2024/11/07 01:18:46 INFO  : file1.txt: Moved (server-side) to: file1.txt..path2
2024/11/07 01:18:46 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file1.txt..path2
2024/11/07 01:18:46 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:46 INFO  : file1.txt..path2: Copied (new)
2024/11/07 01:18:46 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:46 INFO  : file1.txt..path1: Copied (new)
2024/11/07 01:18:46 INFO  : Updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (39)  : test deletes on both sides with default suffix
2024/11/07 01:18:46 NOTICE: (40)  : touch-glob 2005-01-02 /tmp/011836si/datadir/test_resolve-guripip3/ file1R.txt
2024/11/07 01:18:46 NOTICE: (41)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt /tmp/011836si/resolve/path2/ file1.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:18:46 NOTICE: (42)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file2.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:46 NOTICE: (43)  : touch-glob 2006-03-04 /tmp/011836si/datadir/test_resolve-guripip3/ file1L.txt
2024/11/07 01:18:46 NOTICE: (44)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resolve/path1/ file1.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:18:46 NOTICE: (45)  : copy-as /tmp/011836si/datadir/test_resolve-guripip3/file1L.txt /tmp/011836si/resolve/path2/ file2.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:46 NOTICE: (46)  : test bisync run with --conflict-resolve=newer --conflict-loser=delete
2024/11/07 01:18:46 NOTICE: (47)  : bisync conflict-resolve=newer conflict-loser=delete
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" with Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:46 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:46 INFO  : Path1 checking for diffs
2024/11/07 01:18:46 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:46 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:46 INFO  : Path1:    2 changes:    1 new,    1 modified,    0 deleted
2024/11/07 01:18:46 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:46 INFO  : Path2 checking for diffs
2024/11/07 01:18:46 INFO  : - Path2    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:46 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:46 INFO  : Path2:    2 changes:    1 new,    1 modified,    0 deleted
2024/11/07 01:18:46 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:46 INFO  : Applying changes
2024/11/07 01:18:46 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:46 INFO  : Checking potential conflicts...
2024/11/07 01:18:46 NOTICE: Local file system at /tmp/011836si/resolve/path2: 2 differences found
2024/11/07 01:18:46 NOTICE: Local file system at /tmp/011836si/resolve/path2: 2 errors while checking
2024/11/07 01:18:46 INFO  : Finished checking the potential conflicts. 2 differences found
2024/11/07 01:18:46 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:46 INFO  : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s
2024/11/07 01:18:46 INFO  : file1.txt: The winner is: Path1
2024/11/07 01:18:46 NOTICE: - Path2    Deleting Path2 copy                - /tmp/011836si/resolve/path2/file1.txt
2024/11/07 01:18:46 INFO  : file1.txt: Deleted
2024/11/07 01:18:46 INFO  : - Path1    Queue copy to Path2       - file1.txt
2024/11/07 01:18:46 NOTICE: - WARNING  New or changed in both paths       - file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s
2024/11/07 01:18:46 INFO  : file2.txt: The winner is: Path2
2024/11/07 01:18:46 NOTICE: - Path1    Deleting Path1 copy                - TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Deleted
2024/11/07 01:18:46 INFO  : - Path2    Queue copy to Path1       - file2.txt
2024/11/07 01:18:46 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 INFO  : Updating listings
2024/11/07 01:18:46 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resolve/path1/" vs Path2 "/tmp/011836si/resolve/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
    bisync_test.go:558: TEST resolve PASSED
=== RUN   TestBisyncRemoteLocal/resync
2024/11/07 01:18:46 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:46 DEBUG : path1: Making directory
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:46 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/resync/path1"
2024/11/07 01:18:46 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:46 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:46 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/resync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/tmp/011836si/resync/path2"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync/initial"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_resync-nifopat5"
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/initdir/test_resync-nifopat5: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:46 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/initdir/test_resync-nifopat5: Waiting for transfers to finish
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:46 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:46 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:46 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:46 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:46 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:46 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:46 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync/modfiles"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_resync-kawivas6"
2024/11/07 01:18:46 DEBUG : fileA.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : fileB.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/datadir/test_resync-kawivas6: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/datadir/test_resync-kawivas6: Waiting for transfers to finish
2024/11/07 01:18:46 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:46 DEBUG : fileA.txt.16ee54da.partial: renamed to: fileA.txt
2024/11/07 01:18:46 INFO  : fileA.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:46 DEBUG : fileB.txt.f0a2c6af.partial: renamed to: fileB.txt
2024/11/07 01:18:46 INFO  : fileB.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: list [/rclone-test-jisagow5dego/011836si/resync/path1]
2024/11/07 01:18:46 ERROR : : error listing: directory not found
2024/11/07 01:18:46 ERROR : : error listing: directory not found
2024/11/07 01:18:46 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_resync-nifopat5
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: list [/rclone-test-jisagow5dego/011836si/resync/path1]
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/RCLONE_TEST]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file1.txt]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file2.txt]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file3.txt]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: Waiting for transfers to finish
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file4.txt]
2024/11/07 01:18:46 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file5.txt]
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file6.txt]
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: update [/rclone-test-jisagow5dego/011836si/resync/path1/file7.txt]
2024/11/07 01:18:46 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:46 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync/path1: list [/rclone-test-jisagow5dego/011836si/resync/path1]
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/resync/path2: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/resync/path2: Waiting for transfers to finish
2024/11/07 01:18:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:46 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:46 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:46 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:46 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:46 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:46 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 NOTICE: checking path2 Local file system at /tmp/011836si/resync/path2
2024/11/07 01:18:46 NOTICE: (01)  : test resync
2024/11/07 01:18:46 NOTICE: (02)  : test 1. resync with empty path1, resulting in copying all content from path2.
2024/11/07 01:18:46 NOTICE: (03)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync/path1/
2024/11/07 01:18:46 NOTICE: (04)  : bisync resync
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" with Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:46 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:46 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:46 INFO  : Resync updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" vs Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (05)  : move-listings empty-path1
2024/11/07 01:18:46 NOTICE: (06)  : test 2. resync with empty path2, resulting in synching all content to path2.
2024/11/07 01:18:46 NOTICE: (07)  : purge-children /tmp/011836si/resync/path2/
2024/11/07 01:18:46 NOTICE: (08)  : bisync resync
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" with Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:46 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:46 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:46 INFO  : Resync updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" vs Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (09)  : move-listings empty-path2
2024/11/07 01:18:46 NOTICE: (10)  : test 3. exercise all of the various file difference scenarios during a resync.
2024/11/07 01:18:46 NOTICE: (11)  : touch-glob 2002-02-02 /tmp/011836si/datadir/test_resync-kawivas6/ fileA.txt
2024/11/07 01:18:46 NOTICE: (12)  : touch-glob 1999-09-09 /tmp/011836si/datadir/test_resync-kawivas6/ fileB.txt
2024/11/07 01:18:46 NOTICE: (13)  : test = file      - path1      - path2      - expected action    - who wins
2024/11/07 01:18:46 NOTICE: (14)  : test - file1.txt - exists     - missing    - sync path1 > path2 - path1
2024/11/07 01:18:46 NOTICE: (15)  : delete-file /tmp/011836si/resync/path2/file1.txt
2024/11/07 01:18:46 INFO  : file1.txt: Deleted
2024/11/07 01:18:46 NOTICE: (16)  : test - file2.txt - missing    - exists     - copy path2 > path1 - path2
2024/11/07 01:18:46 NOTICE: (17)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync/path1/file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Deleted
2024/11/07 01:18:46 NOTICE: (18)  : test - file3.txt - exists     - newer date - sync path1 > path2 - path1
2024/11/07 01:18:46 NOTICE: (19)  : copy-as /tmp/011836si/datadir/test_resync-kawivas6/fileA.txt /tmp/011836si/resync/path2/ file3.txt
2024/11/07 01:18:46 INFO  : fileA.txt: Copied (replaced existing) to: file3.txt
2024/11/07 01:18:46 NOTICE: (20)  : test - file4.txt - missing    - newer date - copy path2 > path1 - path2
2024/11/07 01:18:46 NOTICE: (21)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync/path1/file4.txt
2024/11/07 01:18:46 INFO  : file4.txt: Deleted
2024/11/07 01:18:46 NOTICE: (22)  : copy-as /tmp/011836si/datadir/test_resync-kawivas6/fileA.txt /tmp/011836si/resync/path2/ file4.txt
2024/11/07 01:18:46 INFO  : fileA.txt: Copied (replaced existing) to: file4.txt
2024/11/07 01:18:46 NOTICE: (23)  : test - file5.txt - exists     - older date - sync path1 > path2 - path1
2024/11/07 01:18:46 NOTICE: (24)  : copy-as /tmp/011836si/datadir/test_resync-kawivas6/fileB.txt /tmp/011836si/resync/path2/ file5.txt
2024/11/07 01:18:46 INFO  : fileB.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:46 NOTICE: (25)  : test - file6.txt - older date - newer date - sync path1 > path2	- path1
2024/11/07 01:18:46 NOTICE: (26)  : copy-as /tmp/011836si/datadir/test_resync-kawivas6/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync/path1/ file6.txt
2024/11/07 01:18:46 INFO  : fileB.txt: Copied (replaced existing) to: file6.txt
2024/11/07 01:18:46 NOTICE: (27)  : copy-as /tmp/011836si/datadir/test_resync-kawivas6/fileA.txt /tmp/011836si/resync/path2/ file6.txt
2024/11/07 01:18:46 INFO  : fileA.txt: Copied (replaced existing) to: file6.txt
2024/11/07 01:18:46 NOTICE: (28)  : test - file7.txt - exists     - exists (same) - none            - same
2024/11/07 01:18:46 NOTICE: (29)  : test run bisync with resync
2024/11/07 01:18:46 NOTICE: (30)  : bisync resync
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" with Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:46 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:46 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 INFO  : file3.txt: Copied (replaced existing)
2024/11/07 01:18:46 INFO  : file5.txt: Copied (replaced existing)
2024/11/07 01:18:46 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:46 INFO  : Resync updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" vs Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (31)  : copy-listings mixed-diffs
2024/11/07 01:18:46 NOTICE: (32)  : test run normal bisync
2024/11/07 01:18:46 NOTICE: (33)  : bisync
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" with Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:46 INFO  : Path1 checking for diffs
2024/11/07 01:18:46 INFO  : Path2 checking for diffs
2024/11/07 01:18:46 INFO  : No changes found
2024/11/07 01:18:46 INFO  : Updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" vs Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (34)  : test 4. confirm critical error on normal sync of empty path.
2024/11/07 01:18:46 NOTICE: (35)  : purge-children /tmp/011836si/resync/path2/
2024/11/07 01:18:46 NOTICE: (36)  : bisync
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync/path1/" with Path2 "/tmp/011836si/resync/path2/"
2024/11/07 01:18:46 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:46 INFO  : Path1 checking for diffs
2024/11/07 01:18:46 INFO  : Path2 checking for diffs
2024/11/07 01:18:46 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_resync_path1..tmp_011836si_resync_path2.path2.lst-new
2024/11/07 01:18:46 ERROR : Bisync critical error: empty current Path2 listing: /tmp/011836si/workdir/TestHdfs_rclone-test-jisagow5dego_011836si_resync_path1..tmp_011836si_resync_path2.path2.lst-new
2024/11/07 01:18:46 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:46 NOTICE: Bisync error: bisync aborted
    bisync_test.go:558: TEST resync PASSED
=== RUN   TestBisyncRemoteLocal/resync_modes
2024/11/07 01:18:46 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:46 DEBUG : path1: Making directory
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:46 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/resync_modes/path1"
2024/11/07 01:18:46 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:46 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:46 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:46 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:46 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/resync_modes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/tmp/011836si/resync_modes/path2"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync_modes/initial"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_resync_modes-maqijej9"
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/initdir/test_resync_modes-maqijej9: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/initdir/test_resync_modes-maqijej9: Waiting for transfers to finish
2024/11/07 01:18:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:46 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_resync_modes/modfiles"
2024/11/07 01:18:46 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_resync_modes-lifuyot7"
2024/11/07 01:18:46 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:18:46 DEBUG : file1L.txt.7d07f91a.partial: renamed to: file1L.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/datadir/test_resync_modes-lifuyot7: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/datadir/test_resync_modes-lifuyot7: Waiting for transfers to finish
2024/11/07 01:18:46 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK
2024/11/07 01:18:46 DEBUG : file1R.txt.cb75035e.partial: renamed to: file1R.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:18:46 DEBUG : file2.txt.7cc9b07.partial: renamed to: file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: list [/rclone-test-jisagow5dego/011836si/resync_modes/path1]
2024/11/07 01:18:46 ERROR : : error listing: directory not found
2024/11/07 01:18:46 ERROR : : error listing: directory not found
2024/11/07 01:18:46 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_resync_modes-maqijej9
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: list [/rclone-test-jisagow5dego/011836si/resync_modes/path1]
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: update [/rclone-test-jisagow5dego/011836si/resync_modes/path1/RCLONE_TEST]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: update [/rclone-test-jisagow5dego/011836si/resync_modes/path1/file1.txt]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: update [/rclone-test-jisagow5dego/011836si/resync_modes/path1/file2.txt]
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: Waiting for transfers to finish
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1
2024/11/07 01:18:46 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/resync_modes/path1: list [/rclone-test-jisagow5dego/011836si/resync_modes/path1]
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:46 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/resync_modes/path2: Waiting for checks to finish
2024/11/07 01:18:46 DEBUG : Local file system at /tmp/011836si/resync_modes/path2: Waiting for transfers to finish
2024/11/07 01:18:46 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:46 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:46 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:46 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:46 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:46 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:46 NOTICE: checking path2 Local file system at /tmp/011836si/resync_modes/path2
2024/11/07 01:18:46 NOTICE: (01)  : test resync-mode
2024/11/07 01:18:46 NOTICE: (02)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:46 NOTICE: (03)  : touch-glob 2001-01-02 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:46 NOTICE: (04)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:46 NOTICE: (05)  : touch-glob 2001-03-04 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:46 NOTICE: (06)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:46 NOTICE: (07)  : test bisync run with --resync-mode=newer
2024/11/07 01:18:46 NOTICE: (08)  : bisync resync resync-mode=newer
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:46 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:46 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:46 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:46 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:46 INFO  : Resync updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (09)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:46 NOTICE: (10)  : touch-glob 2001-07-23 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:46 NOTICE: (11)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:46 NOTICE: (12)  : touch-glob 2001-08-26 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:46 NOTICE: (13)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:46 NOTICE: (14)  : test bisync run with --resync-mode=path2
2024/11/07 01:18:46 NOTICE: (15)  : bisync resync resync-mode=path2
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:46 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:46 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:46 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:46 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:46 INFO  : Resync updating listings
2024/11/07 01:18:46 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:46 INFO  : Bisync successful
2024/11/07 01:18:46 NOTICE: (16)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:46 NOTICE: (17)  : touch-glob 2002-07-23 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:46 NOTICE: (18)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:46 INFO  : file1R.txt: Updated modification time in destination
2024/11/07 01:18:46 NOTICE: (19)  : touch-glob 2002-08-26 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:46 NOTICE: (20)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:46 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:46 NOTICE: (21)  : test bisync run with --resync-mode=larger
2024/11/07 01:18:46 NOTICE: (22)  : bisync resync resync-mode=larger
2024/11/07 01:18:46 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:46 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:46 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:46 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:46 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:46 INFO  : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:18:47 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:47 INFO  : Resync updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (23)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:47 NOTICE: (24)  : touch-glob 2003-07-23 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:47 NOTICE: (25)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:47 INFO  : file1R.txt: Updated modification time in destination
2024/11/07 01:18:47 NOTICE: (26)  : touch-glob 2003-09-04 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:47 NOTICE: (27)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:47 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:47 NOTICE: (28)  : test bisync run with --resync-mode=older
2024/11/07 01:18:47 NOTICE: (29)  : bisync resync resync-mode=older
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:47 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:47 INFO  : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s
2024/11/07 01:18:47 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:47 INFO  : Resync updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (30)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:47 NOTICE: (31)  : touch-glob 2004-07-23 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:47 NOTICE: (32)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:47 INFO  : file1R.txt: Updated modification time in destination
2024/11/07 01:18:47 NOTICE: (33)  : touch-glob 2004-07-23 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:47 NOTICE: (34)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:47 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:47 NOTICE: (35)  : test bisync run with --resync-mode=smaller
2024/11/07 01:18:47 NOTICE: (36)  : bisync resync resync-mode=smaller
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:47 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:47 INFO  : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:18:47 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:47 INFO  : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:18:47 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : Resync updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (37)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:47 NOTICE: (38)  : touch-glob 2005-01-02 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:47 NOTICE: (39)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:47 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:47 NOTICE: (40)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file2.txt
2024/11/07 01:18:47 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:47 NOTICE: (41)  : touch-glob 2006-03-04 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:47 NOTICE: (42)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:47 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:47 NOTICE: (43)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt /tmp/011836si/resync_modes/path2/ file2.txt
2024/11/07 01:18:47 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:47 NOTICE: (44)  : test bisync run with --resync-mode=path1
2024/11/07 01:18:47 NOTICE: (45)  : bisync resync resync-mode=path1
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:47 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:47 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:47 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : Resync updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (46)  : test no winner
2024/11/07 01:18:47 NOTICE: (47)  : touch-glob 2022-02-22 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1R.txt
2024/11/07 01:18:47 NOTICE: (48)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt /tmp/011836si/resync_modes/path2/ file1.txt
2024/11/07 01:18:47 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:47 NOTICE: (49)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file2.txt
2024/11/07 01:18:47 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:47 NOTICE: (50)  : touch-glob 2022-02-22 /tmp/011836si/datadir/test_resync_modes-lifuyot7/ file1L.txt
2024/11/07 01:18:47 NOTICE: (51)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/resync_modes/path1/ file1.txt
2024/11/07 01:18:47 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:47 NOTICE: (52)  : copy-as /tmp/011836si/datadir/test_resync_modes-lifuyot7/file1L.txt /tmp/011836si/resync_modes/path2/ file2.txt
2024/11/07 01:18:47 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:47 NOTICE: (53)  : test bisync run with --resync-mode=newer
2024/11/07 01:18:47 NOTICE: (54)  : bisync resync resync-mode=newer
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" with Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:47 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:47 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:47 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:47 INFO  : Resync updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/resync_modes/path1/" vs Path2 "/tmp/011836si/resync_modes/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
    bisync_test.go:558: TEST resync_modes PASSED
=== RUN   TestBisyncRemoteLocal/rmdirs
2024/11/07 01:18:47 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:47 DEBUG : path1: Making directory
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/rmdirs/path1"
2024/11/07 01:18:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/rmdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011836si/rmdirs/path2"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rmdirs/initial"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_rmdirs-puwubon1"
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:47 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:47 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/initdir/test_rmdirs-puwubon1: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/initdir/test_rmdirs-puwubon1: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:47 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:47 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:47 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:47 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:47 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:47 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_rmdirs/modfiles"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_rmdirs-gunivex0"
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/datadir/test_rmdirs-gunivex0: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/datadir/test_rmdirs-gunivex0: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:47 DEBUG : file1.txt.13f42ab5.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: list [/rclone-test-jisagow5dego/011836si/rmdirs/path1]
2024/11/07 01:18:47 ERROR : : error listing: directory not found
2024/11/07 01:18:47 ERROR : : error listing: directory not found
2024/11/07 01:18:47 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_rmdirs-puwubon1
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: list [/rclone-test-jisagow5dego/011836si/rmdirs/path1]
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : subdir: Making directory
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: mkdir [/rclone-test-jisagow5dego/011836si/rmdirs/path1/subdir]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/file1.copy1.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/RCLONE_TEST]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/file1.copy2.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/file1.copy3.txt]
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: Waiting for transfers to finish
2024/11/07 01:18:47 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/file1.copy4.txt]
2024/11/07 01:18:47 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/file1.copy5.txt]
2024/11/07 01:18:47 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/file1.txt]
2024/11/07 01:18:47 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: update [/rclone-test-jisagow5dego/011836si/rmdirs/path1/subdir/file20.txt]
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:47 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: list [/rclone-test-jisagow5dego/011836si/rmdirs/path1]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/rmdirs/path1: list [/rclone-test-jisagow5dego/011836si/rmdirs/path1/subdir]
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:47 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:47 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:47 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:47 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:47 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:47 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:47 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/rmdirs/path2: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/rmdirs/path2: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:47 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 NOTICE: checking path2 Local file system at /tmp/011836si/rmdirs/path2
2024/11/07 01:18:47 NOTICE: (01)  : test rmdirs
2024/11/07 01:18:47 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:47 NOTICE: (03)  : bisync resync
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1/" with Path2 "/tmp/011836si/rmdirs/path2/"
2024/11/07 01:18:47 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:47 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:47 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:47 INFO  : Resync updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1/" vs Path2 "/tmp/011836si/rmdirs/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (04)  : test 1. delete path1 subdir file
2024/11/07 01:18:47 NOTICE: (05)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rmdirs/path1/subdir/file20.txt
2024/11/07 01:18:47 INFO  : file20.txt: Deleted
2024/11/07 01:18:47 NOTICE: (06)  : test 2. run bisync without remove-empty-dirs
2024/11/07 01:18:47 NOTICE: (07)  : bisync
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1/" with Path2 "/tmp/011836si/rmdirs/path2/"
2024/11/07 01:18:47 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:47 INFO  : Path1 checking for diffs
2024/11/07 01:18:47 INFO  : - Path1    File was deleted          - subdir/file20.txt
2024/11/07 01:18:47 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:47 INFO  : Path2 checking for diffs
2024/11/07 01:18:47 INFO  : Applying changes
2024/11/07 01:18:47 INFO  : - Path2    Queue delete              - /tmp/011836si/rmdirs/path2/subdir/file20.txt
2024/11/07 01:18:47 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:47 INFO  : subdir/file20.txt: Deleted
2024/11/07 01:18:47 INFO  : Updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1/" vs Path2 "/tmp/011836si/rmdirs/path2/"
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (08)  : test 3. confirm the subdir still exists on both paths
2024/11/07 01:18:47 NOTICE: (09)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rmdirs/path1/
2024/11/07 01:18:47 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:47 NOTICE: (10)  : list-dirs /tmp/011836si/rmdirs/path2/
2024/11/07 01:18:47 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:47 NOTICE: (11)  : test 4. run bisync with remove-empty-dirs
2024/11/07 01:18:47 NOTICE: (12)  : bisync remove-empty-dirs
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:47 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:47 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1/" with Path2 "/tmp/011836si/rmdirs/path2/"
2024/11/07 01:18:47 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:47 INFO  : Path1 checking for diffs
2024/11/07 01:18:47 INFO  : Path2 checking for diffs
2024/11/07 01:18:47 INFO  : No changes found
2024/11/07 01:18:47 INFO  : Updating listings
2024/11/07 01:18:47 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/rmdirs/path1/" vs Path2 "/tmp/011836si/rmdirs/path2/"
2024/11/07 01:18:47 INFO  : Removing empty directories
2024/11/07 01:18:47 INFO  : subdir: Removing directory
2024/11/07 01:18:47 INFO  : subdir: Removing directory
2024/11/07 01:18:47 INFO  : Bisync successful
2024/11/07 01:18:47 NOTICE: (13)  : test 5. confirm the subdir has been removed on both paths
2024/11/07 01:18:47 NOTICE: (14)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-jisagow5dego/011836si/rmdirs/path1/
2024/11/07 01:18:47 NOTICE: (15)  : list-dirs /tmp/011836si/rmdirs/path2/
    bisync_test.go:558: TEST rmdirs PASSED
=== RUN   TestBisyncRemoteLocal/volatile
2024/11/07 01:18:47 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-jisagow5dego/011836si" for canonical name "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si"
2024/11/07 01:18:47 DEBUG : path1: Making directory
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si: mkdir [/rclone-test-jisagow5dego/011836si/path1]
2024/11/07 01:18:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-jisagow5dego/011836si/volatile/path1"
2024/11/07 01:18:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-jisagow5dego/011836si/volatile/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-jisagow5dego/011836si/volatile/path1"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011836si/volatile/path2"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_volatile/initial"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011836si/initdir/test_volatile-zopipub7"
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:47 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:47 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:47 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:47 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:47 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:47 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:47 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/initdir/test_volatile-zopipub7: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/initdir/test_volatile-zopipub7: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:47 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_volatile/modfiles"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011836si/datadir/test_volatile-todaqux5"
2024/11/07 01:18:47 DEBUG : dummy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:47 DEBUG : file1.txt.ae546193.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:47 DEBUG : file10.txt.ae546193.partial: renamed to: file10.txt
2024/11/07 01:18:47 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:47 DEBUG : file11.txt.ae546193.partial: renamed to: file11.txt
2024/11/07 01:18:47 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/datadir/test_volatile-todaqux5: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/datadir/test_volatile-todaqux5: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:47 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:47 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:47 DEBUG : file2.txt.8872da9c.partial: renamed to: file2.txt
2024/11/07 01:18:47 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:47 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:47 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : dummy.txt.75bafa33.partial: renamed to: dummy.txt
2024/11/07 01:18:47 INFO  : dummy.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:47 DEBUG : file6.txt.ae546193.partial: renamed to: file6.txt
2024/11/07 01:18:47 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:47 DEBUG : file7.txt.6bedbe24.partial: renamed to: file7.txt
2024/11/07 01:18:47 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: list [/rclone-test-jisagow5dego/011836si/volatile/path1]
2024/11/07 01:18:47 ERROR : : error listing: directory not found
2024/11/07 01:18:47 ERROR : : error listing: directory not found
2024/11/07 01:18:47 NOTICE: checking initFs Local file system at /tmp/011836si/initdir/test_volatile-zopipub7
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: list [/rclone-test-jisagow5dego/011836si/volatile/path1]
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/RCLONE_TEST]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file1.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file2.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file3.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: Waiting for transfers to finish
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file4.txt]
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file5.txt]
2024/11/07 01:18:47 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file6.txt]
2024/11/07 01:18:47 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file7.txt]
2024/11/07 01:18:47 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: update [/rclone-test-jisagow5dego/011836si/volatile/path1/file8.txt]
2024/11/07 01:18:47 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:47 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego/011836si/volatile/path1: list [/rclone-test-jisagow5dego/011836si/volatile/path1]
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/volatile/path2: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011836si/volatile/path2: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:47 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:47 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:47 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:47 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:47 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:47 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:47 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:47 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:47 NOTICE: checking path2 Local file system at /tmp/011836si/volatile/path2
2024/11/07 01:18:47 NOTICE: (01)  : test volatile
2024/11/07 01:18:47 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:47 NOTICE: (03)  : bisync resync
    bisync_test.go:926: skipping 'volatile' test on non-local as it requires uploading 100 files
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego: Purge remote
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-jisagow5dego: purge [/rclone-test-jisagow5dego]
--- PASS: TestBisyncRemoteLocal (11.63s)
    --- PASS: TestBisyncRemoteLocal/all_changed (0.83s)
    --- SKIP: TestBisyncRemoteLocal/backupdir (0.22s)
    --- PASS: TestBisyncRemoteLocal/basic (0.31s)
    --- PASS: TestBisyncRemoteLocal/changes (0.48s)
    --- PASS: TestBisyncRemoteLocal/check_access (0.51s)
    --- PASS: TestBisyncRemoteLocal/check_access_filters (0.85s)
    --- PASS: TestBisyncRemoteLocal/check_filename (0.29s)
    --- PASS: TestBisyncRemoteLocal/check_sync (0.41s)
    --- PASS: TestBisyncRemoteLocal/compare_all (0.43s)
    --- PASS: TestBisyncRemoteLocal/createemptysrcdirs (0.46s)
    --- PASS: TestBisyncRemoteLocal/dry_run (0.52s)
    --- PASS: TestBisyncRemoteLocal/equal (0.19s)
    --- PASS: TestBisyncRemoteLocal/ext_paths (0.56s)
    --- SKIP: TestBisyncRemoteLocal/extended_filenames (0.38s)
    --- PASS: TestBisyncRemoteLocal/filters (0.34s)
    --- PASS: TestBisyncRemoteLocal/filtersfile_checks (0.34s)
    --- PASS: TestBisyncRemoteLocal/ignorelistingchecksum (0.28s)
    --- PASS: TestBisyncRemoteLocal/max_delete_path1 (0.28s)
    --- PASS: TestBisyncRemoteLocal/max_delete_path2_force (0.29s)
    --- PASS: TestBisyncRemoteLocal/nomodtime (0.57s)
    --- SKIP: TestBisyncRemoteLocal/normalization (0.23s)
    --- PASS: TestBisyncRemoteLocal/rclone_args (0.73s)
    --- PASS: TestBisyncRemoteLocal/resolve (0.53s)
    --- PASS: TestBisyncRemoteLocal/resync (0.61s)
    --- PASS: TestBisyncRemoteLocal/resync_modes (0.46s)
    --- PASS: TestBisyncRemoteLocal/rmdirs (0.32s)
    --- SKIP: TestBisyncRemoteLocal/volatile (0.20s)
=== RUN   TestBisyncLocalRemote
2024/11/07 01:18:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi"
2024/11/07 01:18:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 NOTICE: remote: TestHdfs:rclone-test-zedewoz4gosi
=== RUN   TestBisyncLocalRemote/all_changed
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011847xi"
2024/11/07 01:18:47 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011847xi/all_changed/path1"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:47 DEBUG : path2: Making directory
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:47 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/all_changed/path2"
2024/11/07 01:18:47 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:47 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:47 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:47 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2"
2024/11/07 01:18:47 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_all_changed-kopiguy9"
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:47 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:47 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011847xi/initdir/test_all_changed-kopiguy9: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011847xi/initdir/test_all_changed-kopiguy9: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:47 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:47 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:47 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:47 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:47 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:47 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:47 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 ERROR : : error listing: directory not found
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: list [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2]
2024/11/07 01:18:47 ERROR : : error listing: directory not found
2024/11/07 01:18:47 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_all_changed-kopiguy9
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:47 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:47 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:47 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:47 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:47 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:47 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:47 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011847xi/all_changed/path1: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : Local file system at /tmp/011847xi/all_changed/path1: Waiting for transfers to finish
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:47 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:47 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:47 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:47 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:47 NOTICE: checking Path1 Local file system at /tmp/011847xi/all_changed/path1
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: list [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2]
2024/11/07 01:18:47 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : subdir: Making directory
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/subdir]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/RCLONE_TEST]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy1.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy2.txt]
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy3.txt]
2024/11/07 01:18:47 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: Waiting for checks to finish
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: Waiting for transfers to finish
2024/11/07 01:18:47 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy4.txt]
2024/11/07 01:18:47 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy5.txt]
2024/11/07 01:18:47 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.txt]
2024/11/07 01:18:47 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:47 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: update [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/subdir/file20.txt]
2024/11/07 01:18:47 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:47 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:48 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: list [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/all_changed/path2: list [/rclone-test-zedewoz4gosi/011847xi/all_changed/path2/subdir]
2024/11/07 01:18:48 NOTICE: (01)  : test all-changed
2024/11/07 01:18:48 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:48 NOTICE: (03)  : bisync resync
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:48 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:48 INFO  : Synching Path1 "/tmp/011847xi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:48 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:48 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:48 INFO  : Resync updating listings
2024/11/07 01:18:48 INFO  : Validating listings for Path1 "/tmp/011847xi/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Bisync successful
2024/11/07 01:18:48 NOTICE: (04)  : test change timestamp on all files except RCLONE_TEST
2024/11/07 01:18:48 NOTICE: (05)  : touch-glob 2005-01-02 /tmp/011847xi/all_changed/path1/ file*
2024/11/07 01:18:48 NOTICE: (06)  : touch-glob 2005-01-02 /tmp/011847xi/all_changed/path1/subdir file*
2024/11/07 01:18:48 NOTICE: (07)  : test sync should pass
2024/11/07 01:18:48 NOTICE: (08)  : bisync
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:48 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:48 INFO  : Synching Path1 "/tmp/011847xi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:48 INFO  : Path1 checking for diffs
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - file1.copy1.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - file1.copy2.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - file1.copy3.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - file1.copy4.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - file1.copy5.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - subdir/file20.txt
2024/11/07 01:18:48 INFO  : Path1:    7 changes:    0 new,    7 modified,    0 deleted
2024/11/07 01:18:48 INFO  : (Modified:    7 newer,    0 older)
2024/11/07 01:18:48 INFO  : Path2 checking for diffs
2024/11/07 01:18:48 INFO  : Applying changes
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy1.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy2.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy3.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy4.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy5.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/subdir/file20.txt
2024/11/07 01:18:48 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:48 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : Updating listings
2024/11/07 01:18:48 INFO  : Validating listings for Path1 "/tmp/011847xi/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Bisync successful
2024/11/07 01:18:48 NOTICE: (09)  : test change timestamp on all files including RCLONE_TEST
2024/11/07 01:18:48 NOTICE: (10)  : touch-glob 2004-01-02 /tmp/011847xi/all_changed/path1/ *
2024/11/07 01:18:48 NOTICE: (11)  : touch-glob 2004-01-02 /tmp/011847xi/all_changed/path1/subdir *
2024/11/07 01:18:48 NOTICE: (12)  : test sync should fail
2024/11/07 01:18:48 NOTICE: (13)  : bisync
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:48 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:48 INFO  : Synching Path1 "/tmp/011847xi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:48 INFO  : Path1 checking for diffs
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - RCLONE_TEST
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy1.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy2.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy3.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy4.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy5.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - subdir/file20.txt
2024/11/07 01:18:48 INFO  : Path1:    8 changes:    0 new,    8 modified,    0 deleted
2024/11/07 01:18:48 INFO  : (Modified:    1 newer,    7 older)
2024/11/07 01:18:48 INFO  : Path2 checking for diffs
2024/11/07 01:18:48 ERROR : Safety abort: all files were changed on Path1 "/tmp/011847xi/all_changed/path1/". Run with --force if desired.
2024/11/07 01:18:48 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:18:48 NOTICE: Bisync error: all files were changed
2024/11/07 01:18:48 NOTICE: (14)  : test sync with force should pass
2024/11/07 01:18:48 NOTICE: (15)  : bisync force
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:48 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:48 INFO  : Synching Path1 "/tmp/011847xi/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:48 INFO  : Path1 checking for diffs
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (newer) - RCLONE_TEST
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy1.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy2.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy3.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy4.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.copy5.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - file1.txt
2024/11/07 01:18:48 INFO  : - Path1    File changed: time (older) - subdir/file20.txt
2024/11/07 01:18:48 INFO  : Path1:    8 changes:    0 new,    8 modified,    0 deleted
2024/11/07 01:18:48 INFO  : (Modified:    1 newer,    7 older)
2024/11/07 01:18:48 INFO  : Path2 checking for diffs
2024/11/07 01:18:48 INFO  : Applying changes
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/RCLONE_TEST
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy1.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy2.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy3.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy4.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.copy5.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/file1.txt
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/subdir/file20.txt
2024/11/07 01:18:48 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:48 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : Updating listings
2024/11/07 01:18:48 INFO  : Validating listings for Path1 "/tmp/011847xi/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/all_changed/path2/"
2024/11/07 01:18:48 INFO  : Bisync successful
    bisync_test.go:558: TEST all_changed PASSED
=== RUN   TestBisyncLocalRemote/backupdir
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/backupdir/path1"
2024/11/07 01:18:48 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:48 DEBUG : path2: Making directory
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:48 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/backupdir/path2"
2024/11/07 01:18:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:48 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/backupdir/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/backupdir/path2"
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_backupdir-nomamih6"
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:48 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:48 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:48 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/initdir/test_backupdir-nomamih6: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/initdir/test_backupdir-nomamih6: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:48 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:48 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:48 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:48 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:48 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_backupdir-lipabuv9"
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/datadir/test_backupdir-lipabuv9: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/datadir/test_backupdir-lipabuv9: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:48 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:48 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:48 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:48 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:48 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:48 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:48 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:48 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:48 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:48 ERROR : : error listing: directory not found
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: list [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2]
2024/11/07 01:18:48 ERROR : : error listing: directory not found
2024/11/07 01:18:48 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_backupdir-nomamih6
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/backupdir/path1: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/backupdir/path1: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:48 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:48 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:48 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:48 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:48 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:48 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:48 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:48 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:48 NOTICE: checking Path1 Local file system at /tmp/011847xi/backupdir/path1
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: list [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2]
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/RCLONE_TEST]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file1.txt]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file2.txt]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file3.txt]
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file4.txt]
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file5.txt]
2024/11/07 01:18:48 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file6.txt]
2024/11/07 01:18:48 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file7.txt]
2024/11/07 01:18:48 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: update [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2/file8.txt]
2024/11/07 01:18:48 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:48 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:48 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:48 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:48 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/backupdir/path2: list [/rclone-test-zedewoz4gosi/011847xi/backupdir/path2]
2024/11/07 01:18:48 NOTICE: (01)  : test backupdir
2024/11/07 01:18:48 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:48 NOTICE: (03)  : bisync resync backupdir1=/tmp/011847xi/workdir/backupdirs/backupdir1 backupdir2=/tmp/011847xi/workdir/backupdirs/backupdir2
    bisync_test.go:923: backupdir test currently only works on local (it uses the workdir)
=== RUN   TestBisyncLocalRemote/basic
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/basic/path1"
2024/11/07 01:18:48 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:48 DEBUG : path2: Making directory
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:48 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/basic/path2"
2024/11/07 01:18:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:48 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/basic/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/basic/path2"
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_basic-sadived8"
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:48 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:48 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:48 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:48 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:48 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:48 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:48 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/initdir/test_basic-sadived8: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/initdir/test_basic-sadived8: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:48 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_basic-vepipux5"
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/datadir/test_basic-vepipux5: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/datadir/test_basic-vepipux5: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 ERROR : : error listing: directory not found
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: list [/rclone-test-zedewoz4gosi/011847xi/basic/path2]
2024/11/07 01:18:48 ERROR : : error listing: directory not found
2024/11/07 01:18:48 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_basic-sadived8
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:48 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:48 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/basic/path1: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/basic/path1: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:48 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:48 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:48 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:48 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:48 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:48 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 NOTICE: checking Path1 Local file system at /tmp/011847xi/basic/path1
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: list [/rclone-test-zedewoz4gosi/011847xi/basic/path2]
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : subdir: Making directory
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/basic/path2/subdir]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/RCLONE_TEST]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/file1.copy1.txt]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/file1.copy2.txt]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/file1.copy3.txt]
2024/11/07 01:18:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: Waiting for transfers to finish
2024/11/07 01:18:48 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/file1.copy4.txt]
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/file1.copy5.txt]
2024/11/07 01:18:48 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/file1.txt]
2024/11/07 01:18:48 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: update [/rclone-test-zedewoz4gosi/011847xi/basic/path2/subdir/file20.txt]
2024/11/07 01:18:48 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:48 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:48 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: list [/rclone-test-zedewoz4gosi/011847xi/basic/path2]
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/basic/path2: list [/rclone-test-zedewoz4gosi/011847xi/basic/path2/subdir]
2024/11/07 01:18:48 NOTICE: (01)  : test basic
2024/11/07 01:18:48 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:48 NOTICE: (03)  : bisync resync
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:48 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:48 INFO  : Synching Path1 "/tmp/011847xi/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/basic/path2/"
2024/11/07 01:18:48 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:48 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:48 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:48 INFO  : Resync updating listings
2024/11/07 01:18:48 INFO  : Validating listings for Path1 "/tmp/011847xi/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/basic/path2/"
2024/11/07 01:18:48 INFO  : Bisync successful
2024/11/07 01:18:48 NOTICE: (04)  : test place newer files on both paths
2024/11/07 01:18:48 NOTICE: (05)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_basic-vepipux5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/basic/path2/
2024/11/07 01:18:48 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:48 NOTICE: (06)  : copy-as /tmp/011847xi/datadir/test_basic-vepipux5/file1.txt /tmp/011847xi/basic/path1/subdir file20.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (replaced existing) to: file20.txt
2024/11/07 01:18:48 NOTICE: (07)  : test bisync run
2024/11/07 01:18:48 NOTICE: (08)  : bisync
2024/11/07 01:18:48 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:48 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:48 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:48 INFO  : Synching Path1 "/tmp/011847xi/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/basic/path2/"
2024/11/07 01:18:48 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:48 INFO  : Path1 checking for diffs
2024/11/07 01:18:48 INFO  : - Path1    File changed: size (larger), time (newer) - subdir/file20.txt
2024/11/07 01:18:48 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:48 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:48 INFO  : Path2 checking for diffs
2024/11/07 01:18:48 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:48 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:48 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:48 INFO  : Applying changes
2024/11/07 01:18:48 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/basic/path2/subdir/file20.txt
2024/11/07 01:18:48 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/basic/path1/file1.txt
2024/11/07 01:18:48 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:48 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:48 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:48 INFO  : Updating listings
2024/11/07 01:18:48 INFO  : Validating listings for Path1 "/tmp/011847xi/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/basic/path2/"
2024/11/07 01:18:48 INFO  : Bisync successful
    bisync_test.go:558: TEST basic PASSED
=== RUN   TestBisyncLocalRemote/changes
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/changes/path1"
2024/11/07 01:18:48 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:48 DEBUG : path2: Making directory
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:48 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/changes/path2"
2024/11/07 01:18:48 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:48 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:48 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:48 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:48 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/changes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2"
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_changes-nuxocul4"
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/initdir/test_changes-nuxocul4: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:48 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:48 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:48 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/initdir/test_changes-nuxocul4: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:48 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:48 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:48 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:48 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:48 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:48 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:48 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:48 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_changes-mayinus5"
2024/11/07 01:18:48 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/datadir/test_changes-mayinus5: Waiting for checks to finish
2024/11/07 01:18:48 DEBUG : Local file system at /tmp/011847xi/datadir/test_changes-mayinus5: Waiting for transfers to finish
2024/11/07 01:18:48 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:48 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:48 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:48 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:48 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:48 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:48 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:48 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:48 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:48 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:48 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:48 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:48 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:48 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:48 ERROR : : error listing: directory not found
2024/11/07 01:18:48 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: list [/rclone-test-zedewoz4gosi/011847xi/changes/path2]
2024/11/07 01:18:48 ERROR : : error listing: directory not found
2024/11/07 01:18:49 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_changes-nuxocul4
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/changes/path1: Waiting for checks to finish
2024/11/07 01:18:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/changes/path1: Waiting for transfers to finish
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:49 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:49 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:49 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:49 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:49 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:49 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:49 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:49 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:49 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:49 NOTICE: checking Path1 Local file system at /tmp/011847xi/changes/path1
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: list [/rclone-test-zedewoz4gosi/011847xi/changes/path2]
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/RCLONE_TEST]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file1.txt]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file2.txt]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file3.txt]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: Waiting for checks to finish
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: Waiting for transfers to finish
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file4.txt]
2024/11/07 01:18:49 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file5.txt]
2024/11/07 01:18:49 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file6.txt]
2024/11/07 01:18:49 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file7.txt]
2024/11/07 01:18:49 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: update [/rclone-test-zedewoz4gosi/011847xi/changes/path2/file8.txt]
2024/11/07 01:18:49 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:49 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: list [/rclone-test-zedewoz4gosi/011847xi/changes/path2]
2024/11/07 01:18:49 NOTICE: (01)  : test changes
2024/11/07 01:18:49 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:49 NOTICE: (03)  : bisync resync
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/"
2024/11/07 01:18:49 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:49 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:49 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:49 INFO  : Resync updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
2024/11/07 01:18:49 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:18:49 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:18:49 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/
2024/11/07 01:18:49 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:49 NOTICE: (07)  : test newer on path2 - file1
2024/11/07 01:18:49 NOTICE: (08)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/
2024/11/07 01:18:49 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:49 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:18:49 NOTICE: (10)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/file11.txt /tmp/011847xi/changes/path1/
2024/11/07 01:18:49 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:49 NOTICE: (11)  : test newer on path1 - file2
2024/11/07 01:18:49 NOTICE: (12)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/file2.txt /tmp/011847xi/changes/path1/
2024/11/07 01:18:49 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:49 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:18:49 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/file3.txt
2024/11/07 01:18:49 INFO  : file3.txt: Deleted
2024/11/07 01:18:49 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:18:49 NOTICE: (16)  : delete-file /tmp/011847xi/changes/path1/file4.txt
2024/11/07 01:18:49 INFO  : file4.txt: Deleted
2024/11/07 01:18:49 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:18:49 NOTICE: (18)  : delete-file /tmp/011847xi/changes/path1/file8.txt
2024/11/07 01:18:49 INFO  : file8.txt: Deleted
2024/11/07 01:18:49 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/file8.txt
2024/11/07 01:18:49 INFO  : file8.txt: Deleted
2024/11/07 01:18:49 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:18:49 NOTICE: (21)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/ file5R.txt
2024/11/07 01:18:49 NOTICE: (22)  : copy-as /tmp/011847xi/datadir/test_changes-mayinus5/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/ file5.txt
2024/11/07 01:18:49 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:49 NOTICE: (23)  : touch-glob 2001-03-04 /tmp/011847xi/datadir/test_changes-mayinus5/ file5L.txt
2024/11/07 01:18:49 NOTICE: (24)  : copy-as /tmp/011847xi/datadir/test_changes-mayinus5/file5L.txt /tmp/011847xi/changes/path1/ file5.txt
2024/11/07 01:18:49 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:49 NOTICE: (25)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:18:49 NOTICE: (26)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/
2024/11/07 01:18:49 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:49 NOTICE: (27)  : delete-file /tmp/011847xi/changes/path1/file6.txt
2024/11/07 01:18:49 INFO  : file6.txt: Deleted
2024/11/07 01:18:49 NOTICE: (28)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:18:49 NOTICE: (29)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_changes-mayinus5/file7.txt /tmp/011847xi/changes/path1/
2024/11/07 01:18:49 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:49 NOTICE: (30)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/changes/path2/file7.txt
2024/11/07 01:18:49 INFO  : file7.txt: Deleted
2024/11/07 01:18:49 NOTICE: (31)  : test bisync run
2024/11/07 01:18:49 NOTICE: (32)  : bisync
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/"
2024/11/07 01:18:49 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:49 INFO  : Path1 checking for diffs
2024/11/07 01:18:49 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:49 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:49 INFO  : - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:49 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:49 INFO  : - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:18:49 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:18:49 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:49 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:49 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:49 INFO  : Path2 checking for diffs
2024/11/07 01:18:49 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:49 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:49 INFO  : - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:49 INFO  : - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:18:49 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:49 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:18:49 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:49 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:49 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:49 INFO  : Applying changes
2024/11/07 01:18:49 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:49 INFO  : Checking potential conflicts...
2024/11/07 01:18:49 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: 1 differences found
2024/11/07 01:18:49 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/changes/path2: 1 errors while checking
2024/11/07 01:18:49 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:49 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/file11.txt
2024/11/07 01:18:49 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/file2.txt
2024/11/07 01:18:49 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/file4.txt
2024/11/07 01:18:49 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:49 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/changes/path1/file5.txt.conflict1
2024/11/07 01:18:49 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:49 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/file5.txt.conflict1
2024/11/07 01:18:49 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/file5.txt.conflict2
2024/11/07 01:18:49 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:49 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/changes/path1/file5.txt.conflict2
2024/11/07 01:18:49 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/changes/path1/file6.txt
2024/11/07 01:18:49 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/file7.txt
2024/11/07 01:18:49 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/changes/path1/file1.txt
2024/11/07 01:18:49 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/changes/path1/file10.txt
2024/11/07 01:18:49 INFO  : - Path1    Queue delete              - /tmp/011847xi/changes/path1/file3.txt
2024/11/07 01:18:49 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:49 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:49 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:49 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file3.txt: Deleted
2024/11/07 01:18:49 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:49 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:49 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:49 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:49 INFO  : file4.txt: Deleted
2024/11/07 01:18:49 INFO  : Updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/changes/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
    bisync_test.go:558: TEST changes PASSED
=== RUN   TestBisyncLocalRemote/check_access
2024/11/07 01:18:49 DEBUG : Creating backend with remote "/tmp/011847xi/check_access/path1"
2024/11/07 01:18:49 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:49 DEBUG : path2: Making directory
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:49 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_access/path2"
2024/11/07 01:18:49 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:49 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:49 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:49 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:49 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_access/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2"
2024/11/07 01:18:49 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_check_access-kopuqeh0"
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:49 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:49 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_access-kopuqeh0: Waiting for checks to finish
2024/11/07 01:18:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:49 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_access-kopuqeh0: Waiting for transfers to finish
2024/11/07 01:18:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:49 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:49 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:49 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:49 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:49 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_check_access-bijocop8"
2024/11/07 01:18:49 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_access-bijocop8: Waiting for checks to finish
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_access-bijocop8: Waiting for transfers to finish
2024/11/07 01:18:49 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:49 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:49 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:49 ERROR : : error listing: directory not found
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access/path2]
2024/11/07 01:18:49 ERROR : : error listing: directory not found
2024/11/07 01:18:49 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_check_access-kopuqeh0
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:49 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:49 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/check_access/path1: Waiting for checks to finish
2024/11/07 01:18:49 DEBUG : Local file system at /tmp/011847xi/check_access/path1: Waiting for transfers to finish
2024/11/07 01:18:49 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:49 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:49 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:49 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:49 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:49 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:49 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:49 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 NOTICE: checking Path1 Local file system at /tmp/011847xi/check_access/path1
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access/path2]
2024/11/07 01:18:49 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : subdir: Making directory
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/subdir]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/RCLONE_TEST]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/file1.txt]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/file2.txt]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/file3.txt]
2024/11/07 01:18:49 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: Waiting for checks to finish
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: Waiting for transfers to finish
2024/11/07 01:18:49 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/file4.txt]
2024/11/07 01:18:49 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/subdir/RCLONE_TEST]
2024/11/07 01:18:49 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/subdir/file20.txt]
2024/11/07 01:18:49 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:49 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access/path2]
2024/11/07 01:18:49 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access/path2/subdir]
2024/11/07 01:18:49 NOTICE: (01)  : test check-access
2024/11/07 01:18:49 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:49 NOTICE: (03)  : bisync resync
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:49 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:49 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:49 INFO  : Resync updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
2024/11/07 01:18:49 NOTICE: (04)  : test 1. see that check-access passes with the initial setup
2024/11/07 01:18:49 NOTICE: (05)  : bisync check-access
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:49 INFO  : Path1 checking for diffs
2024/11/07 01:18:49 INFO  : Path2 checking for diffs
2024/11/07 01:18:49 INFO  : Checking access health
2024/11/07 01:18:49 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:49 INFO  : No changes found
2024/11/07 01:18:49 INFO  : Updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
2024/11/07 01:18:49 NOTICE: (06)  : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical.
2024/11/07 01:18:49 NOTICE: (07)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access/path2/subdir/RCLONE_TEST
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:49 NOTICE: (08)  : bisync check-access
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:49 INFO  : Path1 checking for diffs
2024/11/07 01:18:49 INFO  : Path2 checking for diffs
2024/11/07 01:18:49 INFO  : - Path2    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:18:49 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:49 INFO  : Checking access health
2024/11/07 01:18:49 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST
2024/11/07 01:18:49 ERROR : -          Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST
2024/11/07 01:18:49 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:49 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:49 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:49 NOTICE: (09)  : copy-listings path2-missing
2024/11/07 01:18:49 NOTICE: (10)  : test 3. put the path2 subdir RCLONE_TEST back, resync.
2024/11/07 01:18:49 NOTICE: (11)  : copy-file /tmp/011847xi/check_access/path1/subdir/RCLONE_TEST TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access/path2/
2024/11/07 01:18:49 NOTICE: (12)  : bisync resync
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:49 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:49 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:49 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 INFO  : Resync updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
2024/11/07 01:18:49 NOTICE: (13)  : test 4. run sync with check-access. should pass.
2024/11/07 01:18:49 NOTICE: (14)  : bisync check-access
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:49 INFO  : Path1 checking for diffs
2024/11/07 01:18:49 INFO  : Path2 checking for diffs
2024/11/07 01:18:49 INFO  : Checking access health
2024/11/07 01:18:49 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:49 INFO  : No changes found
2024/11/07 01:18:49 INFO  : Updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
2024/11/07 01:18:49 NOTICE: (15)  : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical.
2024/11/07 01:18:49 NOTICE: (16)  : delete-file /tmp/011847xi/check_access/path1/RCLONE_TEST
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:49 NOTICE: (17)  : bisync check-access
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:49 INFO  : Path1 checking for diffs
2024/11/07 01:18:49 INFO  : - Path1    File was deleted          - RCLONE_TEST
2024/11/07 01:18:49 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:49 INFO  : Path2 checking for diffs
2024/11/07 01:18:49 INFO  : Checking access health
2024/11/07 01:18:49 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST
2024/11/07 01:18:49 ERROR : -          Access test failed: Path2 file not found in Path1 - RCLONE_TEST
2024/11/07 01:18:49 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:49 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:49 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:49 NOTICE: (18)  : copy-listings path1-missing
2024/11/07 01:18:49 NOTICE: (19)  : test 6. run again. should fail critical due to missing listings.
2024/11/07 01:18:49 NOTICE: (20)  : bisync check-access
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011847xi/workdir/tmp_011847xi_check_access_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_access_path2.path1.lst
Path2: /tmp/011847xi/workdir/tmp_011847xi_check_access_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_access_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011847xi/workdir"
2024/11/07 01:18:49 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:49 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:49 NOTICE: (21)  : move-listings missing-listings
2024/11/07 01:18:49 NOTICE: (22)  : test 7. run resync, which will copy the path2 top level back to path1.
2024/11/07 01:18:49 NOTICE: (23)  : bisync resync
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:49 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:49 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:49 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:49 INFO  : Resync updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
2024/11/07 01:18:49 NOTICE: (24)  : test 8. run sync with --check-access. should pass.
2024/11/07 01:18:49 NOTICE: (25)  : bisync check-access
2024/11/07 01:18:49 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:49 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:49 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:49 INFO  : Synching Path1 "/tmp/011847xi/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:49 INFO  : Path1 checking for diffs
2024/11/07 01:18:49 INFO  : Path2 checking for diffs
2024/11/07 01:18:49 INFO  : Checking access health
2024/11/07 01:18:49 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:49 INFO  : No changes found
2024/11/07 01:18:49 INFO  : Updating listings
2024/11/07 01:18:49 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access/path2/"
2024/11/07 01:18:49 INFO  : Bisync successful
    bisync_test.go:558: TEST check_access PASSED
=== RUN   TestBisyncLocalRemote/check_access_filters
2024/11/07 01:18:50 DEBUG : Creating backend with remote "/tmp/011847xi/check_access_filters/path1"
2024/11/07 01:18:50 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:50 DEBUG : path2: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:50 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2"
2024/11/07 01:18:50 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:50 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:50 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:50 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:50 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2"
2024/11/07 01:18:50 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_check_access_filters-wuyizix8"
2024/11/07 01:18:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:50 DEBUG : subdir-not: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not
2024/11/07 01:18:50 DEBUG : subdirX: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdirX", newDst=subdirX
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA
2024/11/07 01:18:50 DEBUG : subdir/subdirB: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:50 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:50 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:50 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:50 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2: Making directory with metadata
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt.5028a97.partial: renamed to: subdirX/file20.txt
2024/11/07 01:18:50 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt.5028a97.partial: renamed to: subdirX/subdirX1/file30.txt
2024/11/07 01:18:50 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:50 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt.5028a97.partial: renamed to: subdir/subdirB/file30.txt
2024/11/07 01:18:50 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt.5028a97.partial: renamed to: subdir/subdirA/file30.txt
2024/11/07 01:18:50 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_access_filters-wuyizix8: Waiting for checks to finish
2024/11/07 01:18:50 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_access_filters-wuyizix8: Waiting for transfers to finish
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirB/RCLONE_TEST
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt.5028a97.partial: renamed to: subdir-not/file20.txt
2024/11/07 01:18:50 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt.5028a97.partial: renamed to: subdir-not/subdir-not2/file30.txt
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_check_access_filters-depehor0"
2024/11/07 01:18:50 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_access_filters-depehor0: Waiting for checks to finish
2024/11/07 01:18:50 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_access_filters-depehor0: Waiting for transfers to finish
2024/11/07 01:18:50 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK
2024/11/07 01:18:50 DEBUG : exclude-other-filtersfile.txt.9180e6d6.partial: renamed to: exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : exclude-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK
2024/11/07 01:18:50 DEBUG : include-other-filtersfile.txt.5fb1cd78.partial: renamed to: include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : include-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:50 ERROR : : error listing: directory not found
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2]
2024/11/07 01:18:50 ERROR : : error listing: directory not found
2024/11/07 01:18:50 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_check_access_filters-wuyizix8
2024/11/07 01:18:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:50 DEBUG : subdir-not: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not
2024/11/07 01:18:50 DEBUG : subdirX: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdirX", newDst=subdirX
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA
2024/11/07 01:18:50 DEBUG : subdir/subdirB: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2: Making directory with metadata
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:50 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:50 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:50 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:50 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : Local file system at /tmp/011847xi/check_access_filters/path1: Waiting for checks to finish
2024/11/07 01:18:50 DEBUG : Local file system at /tmp/011847xi/check_access_filters/path1: Waiting for transfers to finish
2024/11/07 01:18:50 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:50 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt.5028a97.partial: renamed to: subdirX/subdirX1/file30.txt
2024/11/07 01:18:50 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:50 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt.5028a97.partial: renamed to: subdirX/file20.txt
2024/11/07 01:18:50 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt.5028a97.partial: renamed to: subdir/subdirB/file30.txt
2024/11/07 01:18:50 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt.5028a97.partial: renamed to: subdir-not/file20.txt
2024/11/07 01:18:50 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt.5028a97.partial: renamed to: subdir-not/subdir-not2/file30.txt
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt.5028a97.partial: renamed to: subdir/subdirA/file30.txt
2024/11/07 01:18:50 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirB/RCLONE_TEST
2024/11/07 01:18:50 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 NOTICE: checking Path1 Local file system at /tmp/011847xi/check_access_filters/path1
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2]
2024/11/07 01:18:50 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/RCLONE_TEST]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/file1.txt]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/file2.txt]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/file3.txt]
2024/11/07 01:18:50 DEBUG : subdir-not: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not]
2024/11/07 01:18:50 DEBUG : subdirX: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX]
2024/11/07 01:18:50 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX/subdirX1]
2024/11/07 01:18:50 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirA]
2024/11/07 01:18:50 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/subdir-not2]
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirB: Making directory
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirB]
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: Waiting for checks to finish
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: Waiting for transfers to finish
2024/11/07 01:18:50 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/file4.txt]
2024/11/07 01:18:50 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX/file20.txt]
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/file20.txt]
2024/11/07 01:18:50 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/file20.txt]
2024/11/07 01:18:50 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX/subdirX1/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX/subdirX1/file30.txt]
2024/11/07 01:18:50 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/subdir-not2/file30.txt]
2024/11/07 01:18:50 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirB/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirB/file30.txt]
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirA/RCLONE_TEST]
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirA/file30.txt]
2024/11/07 01:18:50 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:18:50 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:18:50 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdirX/subdirX1]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/subdir-not2]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirB]
2024/11/07 01:18:50 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirA]
2024/11/07 01:18:50 NOTICE: (01)  : test check-access-filters
2024/11/07 01:18:50 NOTICE: (02)  : test EXCLUDE - OTHER TESTS
2024/11/07 01:18:50 NOTICE: (03)  : copy-file /tmp/011847xi/datadir/test_check_access_filters-depehor0/exclude-other-filtersfile.txt /tmp/011847xi/workdir/
2024/11/07 01:18:50 INFO  : exclude-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:50 NOTICE: (04)  : test resync to get the filters file md5 built.
2024/11/07 01:18:50 NOTICE: (05)  : bisync resync filters-file=/tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Storing filters file hash to /tmp/011847xi/workdir/exclude-other-filtersfile.txt.md5
2024/11/07 01:18:50 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:50 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:50 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:50 INFO  : Resync updating listings
2024/11/07 01:18:50 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Bisync successful
2024/11/07 01:18:50 NOTICE: (06)  : test EXCLUDE - test filters for check access
2024/11/07 01:18:50 NOTICE: (07)  : bisync check-access filters-file=/tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:50 INFO  : Path1 checking for diffs
2024/11/07 01:18:50 INFO  : Path2 checking for diffs
2024/11/07 01:18:50 INFO  : Checking access health
2024/11/07 01:18:50 INFO  : Found 3 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:50 INFO  : No changes found
2024/11/07 01:18:50 INFO  : Updating listings
2024/11/07 01:18:50 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Bisync successful
2024/11/07 01:18:50 NOTICE: (08)  : copy-listings exclude-initial
2024/11/07 01:18:50 NOTICE: (09)  : test EXCLUDE - delete RCLONE_TEST files in excluded directories
2024/11/07 01:18:50 NOTICE: (10)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (11)  : delete-file /tmp/011847xi/check_access_filters/path1/subdir-not/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (12)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (13)  : delete-file /tmp/011847xi/check_access_filters/path1/subdirX/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (14)  : test EXCLUDE - test should PASS
2024/11/07 01:18:50 NOTICE: (15)  : bisync check-access filters-file=/tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:50 INFO  : Path1 checking for diffs
2024/11/07 01:18:50 INFO  : Path2 checking for diffs
2024/11/07 01:18:50 INFO  : Checking access health
2024/11/07 01:18:50 INFO  : Found 3 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:50 INFO  : No changes found
2024/11/07 01:18:50 INFO  : Updating listings
2024/11/07 01:18:50 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Bisync successful
2024/11/07 01:18:50 NOTICE: (16)  : copy-listings exclude-pass-run
2024/11/07 01:18:50 NOTICE: (17)  : test EXCLUDE - delete RCLONE_TEST files in included directories
2024/11/07 01:18:50 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (19)  : delete-file /tmp/011847xi/check_access_filters/path1/subdir/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (20)  : test EXCLUDE - test should ABORT
2024/11/07 01:18:50 NOTICE: (21)  : bisync check-access filters-file=/tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/exclude-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:50 INFO  : Path1 checking for diffs
2024/11/07 01:18:50 INFO  : - Path1    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:18:50 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:50 INFO  : Path2 checking for diffs
2024/11/07 01:18:50 INFO  : - Path2    File was deleted          - RCLONE_TEST
2024/11/07 01:18:50 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:50 INFO  : Checking access health
2024/11/07 01:18:50 ERROR : -          Access test failed: Path1 file not found in Path2 - RCLONE_TEST
2024/11/07 01:18:50 ERROR : -          Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST
2024/11/07 01:18:50 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:50 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:50 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:50 NOTICE: (22)  : move-listings exclude-error-run
2024/11/07 01:18:50 NOTICE: (23)  : test INCLUDE - OTHER TESTS
2024/11/07 01:18:50 NOTICE: (24)  : test reset to the initial state
2024/11/07 01:18:50 NOTICE: (25)  : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial /tmp/011847xi/check_access_filters/path1/
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 NOTICE: (26)  : sync-dir /tmp/011847xi/check_access_filters/path1/ TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:18:50 NOTICE: (27)  : copy-file /tmp/011847xi/datadir/test_check_access_filters-depehor0/include-other-filtersfile.txt /tmp/011847xi/workdir/
2024/11/07 01:18:50 INFO  : include-other-filtersfile.txt: Copied (new)
2024/11/07 01:18:50 NOTICE: (28)  : bisync resync filters-file=/tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Storing filters file hash to /tmp/011847xi/workdir/include-other-filtersfile.txt.md5
2024/11/07 01:18:50 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:50 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:50 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:50 INFO  : Resync updating listings
2024/11/07 01:18:50 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Bisync successful
2024/11/07 01:18:50 NOTICE: (29)  : test INCLUDE - test include/exclude filters for check access
2024/11/07 01:18:50 NOTICE: (30)  : bisync check-access filters-file=/tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:50 INFO  : Path1 checking for diffs
2024/11/07 01:18:50 INFO  : Path2 checking for diffs
2024/11/07 01:18:50 INFO  : Checking access health
2024/11/07 01:18:50 INFO  : Found 5 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:50 INFO  : No changes found
2024/11/07 01:18:50 INFO  : Updating listings
2024/11/07 01:18:50 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Bisync successful
2024/11/07 01:18:50 NOTICE: (31)  : copy-listings include-initial
2024/11/07 01:18:50 NOTICE: (32)  : test INCLUDE - delete RCLONE_TEST files in excluded directories
2024/11/07 01:18:50 NOTICE: (33)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir/subdirA/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (34)  : delete-file /tmp/011847xi/check_access_filters/path1/subdir-not/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (35)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (36)  : test INCLUDE - test should PASS
2024/11/07 01:18:50 NOTICE: (37)  : bisync check-access filters-file=/tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:50 INFO  : Path1 checking for diffs
2024/11/07 01:18:50 INFO  : Path2 checking for diffs
2024/11/07 01:18:50 INFO  : Checking access health
2024/11/07 01:18:50 INFO  : Found 5 matching "RCLONE_TEST" files on both paths
2024/11/07 01:18:50 INFO  : No changes found
2024/11/07 01:18:50 INFO  : Updating listings
2024/11/07 01:18:50 INFO  : Validating listings for Path1 "/tmp/011847xi/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Bisync successful
2024/11/07 01:18:50 NOTICE: (38)  : copy-listings include-pass-run
2024/11/07 01:18:50 NOTICE: (39)  : test INCLUDE - delete RCLONE_TEST files in included directories
2024/11/07 01:18:50 NOTICE: (40)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (41)  : delete-file /tmp/011847xi/check_access_filters/path1/subdir/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (42)  : delete-file /tmp/011847xi/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:50 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:50 NOTICE: (43)  : test INCLUDE - test should ABORT
2024/11/07 01:18:50 NOTICE: (44)  : bisync check-access filters-file=/tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:18:50 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:50 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:50 INFO  : Synching Path1 "/tmp/011847xi/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_access_filters/path2/"
2024/11/07 01:18:50 INFO  : Using filters file /tmp/011847xi/workdir/include-other-filtersfile.txt
2024/11/07 01:18:50 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:50 INFO  : Path1 checking for diffs
2024/11/07 01:18:50 INFO  : - Path1    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:18:50 INFO  : - Path1    File was deleted          - subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:50 INFO  : Path1:    2 changes:    0 new,    0 modified,    2 deleted
2024/11/07 01:18:50 INFO  : Path2 checking for diffs
2024/11/07 01:18:50 INFO  : - Path2    File was deleted          - RCLONE_TEST
2024/11/07 01:18:50 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:50 INFO  : Checking access health
2024/11/07 01:18:50 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST
2024/11/07 01:18:50 ERROR : -          Access test failed: Path1 file not found in Path2 - RCLONE_TEST
2024/11/07 01:18:50 ERROR : -          Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:18:50 ERROR : -          Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST
2024/11/07 01:18:50 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:50 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:50 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:50 NOTICE: (45)  : move-listings include-error-run
    bisync_test.go:558: TEST check_access_filters PASSED
=== RUN   TestBisyncLocalRemote/check_filename
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/check_filename/path1"
2024/11/07 01:18:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:51 DEBUG : path2: Making directory
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_filename/path2"
2024/11/07 01:18:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_filename/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2"
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_check_filename-fuxiled8"
2024/11/07 01:18:51 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:51 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:51 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:51 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_filename-fuxiled8: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_filename-fuxiled8: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:51 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : .chk_file.cf9a93ac.partial: renamed to: .chk_file
2024/11/07 01:18:51 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:51 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : subdir/.chk_file.cf9a93ac.partial: renamed to: subdir/.chk_file
2024/11/07 01:18:51 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_check_filename-ceqacag4"
2024/11/07 01:18:51 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_filename-ceqacag4: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_filename-ceqacag4: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:51 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:51 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:51 ERROR : : error listing: directory not found
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2]
2024/11/07 01:18:51 ERROR : : error listing: directory not found
2024/11/07 01:18:51 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_check_filename-fuxiled8
2024/11/07 01:18:51 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:51 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:51 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:51 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : .chk_file.cf9a93ac.partial: renamed to: .chk_file
2024/11/07 01:18:51 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/check_filename/path1: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/check_filename/path1: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:51 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : subdir/.chk_file.cf9a93ac.partial: renamed to: subdir/.chk_file
2024/11/07 01:18:51 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 NOTICE: checking Path1 Local file system at /tmp/011847xi/check_filename/path1
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2]
2024/11/07 01:18:51 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : subdir: Making directory
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/subdir]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/file1.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/file2.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/file3.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/.chk_file]
2024/11/07 01:18:51 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: Waiting for transfers to finish
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/file4.txt]
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/subdir/.chk_file]
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/subdir/file20.txt]
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:51 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:18:51 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_filename/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_filename/path2/subdir]
2024/11/07 01:18:51 NOTICE: (01)  : test check-filename
2024/11/07 01:18:51 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:51 NOTICE: (03)  : bisync resync
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:51 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:51 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:51 INFO  : Resync updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (04)  : test 1. see that check-access passes with the initial setup
2024/11/07 01:18:51 NOTICE: (05)  : bisync check-access check-filename=.chk_file
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:51 INFO  : Path1 checking for diffs
2024/11/07 01:18:51 INFO  : Path2 checking for diffs
2024/11/07 01:18:51 INFO  : Checking access health
2024/11/07 01:18:51 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:18:51 INFO  : No changes found
2024/11/07 01:18:51 INFO  : Updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (06)  : copy-listings initial-pass
2024/11/07 01:18:51 NOTICE: (07)  : test 2. delete the remote subdir .chk_file, run sync. should fail critical.
2024/11/07 01:18:51 NOTICE: (08)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_filename/path2/subdir/.chk_file
2024/11/07 01:18:51 INFO  : .chk_file: Deleted
2024/11/07 01:18:51 NOTICE: (09)  : bisync check-access check-filename=.chk_file
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:51 INFO  : Path1 checking for diffs
2024/11/07 01:18:51 INFO  : Path2 checking for diffs
2024/11/07 01:18:51 INFO  : - Path2    File was deleted          - subdir/.chk_file
2024/11/07 01:18:51 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:51 INFO  : Checking access health
2024/11/07 01:18:51 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file
2024/11/07 01:18:51 ERROR : -          Access test failed: Path1 file not found in Path2 - subdir/.chk_file
2024/11/07 01:18:51 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:51 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:51 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:51 NOTICE: (10)  : move-listings path2-missing
2024/11/07 01:18:51 NOTICE: (11)  : test 3. put the remote subdir .chk_file back, run resync.
2024/11/07 01:18:51 NOTICE: (12)  : copy-file /tmp/011847xi/check_filename/path1/subdir/.chk_file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/check_filename/path2/subdir/
2024/11/07 01:18:51 INFO  : .chk_file: Copied (new)
2024/11/07 01:18:51 NOTICE: (13)  : bisync check-access resync check-filename=.chk_file
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:51 INFO  : Checking access health
2024/11/07 01:18:51 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:18:51 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:51 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:51 INFO  : Resync updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (14)  : test 4. run sync with check-access. should pass.
2024/11/07 01:18:51 NOTICE: (15)  : bisync check-access check-filename=.chk_file
2024/11/07 01:18:51 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:51 INFO  : Path1 checking for diffs
2024/11/07 01:18:51 INFO  : Path2 checking for diffs
2024/11/07 01:18:51 INFO  : Checking access health
2024/11/07 01:18:51 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:18:51 INFO  : No changes found
2024/11/07 01:18:51 INFO  : Updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_filename/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
    bisync_test.go:558: TEST check_filename PASSED
=== RUN   TestBisyncLocalRemote/check_sync
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/check_sync/path1"
2024/11/07 01:18:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:51 DEBUG : path2: Making directory
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_sync/path2"
2024/11/07 01:18:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/check_sync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2"
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_check_sync-fadifap1"
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_sync-fadifap1: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/initdir/test_check_sync-fadifap1: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:51 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:51 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:51 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_check_sync-cawumul9"
2024/11/07 01:18:51 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_sync-cawumul9: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/datadir/test_check_sync-cawumul9: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK
2024/11/07 01:18:51 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK
2024/11/07 01:18:51 DEBUG : _testdir_path1.._testdir_path2.path1.lst.c670fe74.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst
2024/11/07 01:18:51 INFO  : _testdir_path1.._testdir_path2.path1.lst: Copied (new)
2024/11/07 01:18:51 DEBUG : _testdir_path1.._testdir_path2.path2.lst.c670fe74.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst
2024/11/07 01:18:51 INFO  : _testdir_path1.._testdir_path2.path2.lst: Copied (new)
2024/11/07 01:18:51 ERROR : : error listing: directory not found
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2]
2024/11/07 01:18:51 ERROR : : error listing: directory not found
2024/11/07 01:18:51 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_check_sync-fadifap1
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/check_sync/path1: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/check_sync/path1: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:51 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:51 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:51 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:51 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: checking Path1 Local file system at /tmp/011847xi/check_sync/path1
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2]
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file1.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file2.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file3.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/RCLONE_TEST]
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file4.txt]
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file5.txt]
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file6.txt]
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file7.txt]
2024/11/07 01:18:51 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: update [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2/file8.txt]
2024/11/07 01:18:51 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/check_sync/path2: list [/rclone-test-zedewoz4gosi/011847xi/check_sync/path2]
2024/11/07 01:18:51 NOTICE: (01)  : test check-sync
2024/11/07 01:18:51 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:51 NOTICE: (03)  : bisync resync
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:51 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:51 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:51 INFO  : Resync updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (04)  : test 1. run check-sync-only on a clean sync
2024/11/07 01:18:51 NOTICE: (05)  : bisync check-sync-only
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (06)  : test 2. inject modified listings into the workdir
2024/11/07 01:18:51 NOTICE: (07)  : copy-as /tmp/011847xi/datadir/test_check_sync-cawumul9/_testdir_path1.._testdir_path2.path1.lst /tmp/011847xi/workdir/ tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path1.lst
2024/11/07 01:18:51 INFO  : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path1.lst
2024/11/07 01:18:51 NOTICE: (08)  : copy-as /tmp/011847xi/datadir/test_check_sync-cawumul9/_testdir_path1.._testdir_path2.path2.lst /tmp/011847xi/workdir/ tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path2.lst
2024/11/07 01:18:51 INFO  : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path2.lst
2024/11/07 01:18:51 NOTICE: (09)  : test 3. run check-sync-only on modified listings
2024/11/07 01:18:51 NOTICE: (10)  : bisync check-sync-only
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 ERROR : -          Path1 file not found in Path2      - file2.txt
2024/11/07 01:18:51 ERROR : -          Path2 file not found in Path1      - file1.txt
2024/11/07 01:18:51 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover
2024/11/07 01:18:51 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:51 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:51 NOTICE: (11)  : copy-listings check-sync-only
2024/11/07 01:18:51 NOTICE: (12)  : test 4. run normal sync to check that it aborts
2024/11/07 01:18:51 NOTICE: (13)  : bisync
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011847xi/workdir/tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path1.lst
Path2: /tmp/011847xi/workdir/tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011847xi/workdir"
2024/11/07 01:18:51 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:51 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:51 NOTICE: (14)  : test 5. prune failure listings after critical abort
2024/11/07 01:18:51 NOTICE: (15)  : delete-glob /tmp/011847xi/workdir/ *.lst
2024/11/07 01:18:51 NOTICE: (16)  : delete-glob /tmp/011847xi/workdir/ *.lst-err
2024/11/07 01:18:51 INFO  : tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path1.lst-err: Deleted
2024/11/07 01:18:51 INFO  : tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path2.lst-err: Deleted
2024/11/07 01:18:51 NOTICE: (17)  : delete-glob /tmp/011847xi/workdir/ *.lst-new
2024/11/07 01:18:51 INFO  : tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path1.lst-new: Deleted
2024/11/07 01:18:51 INFO  : tmp_011847xi_check_sync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_check_sync_path2.path2.lst-new: Deleted
2024/11/07 01:18:51 NOTICE: (18)  : test 6. run resync
2024/11/07 01:18:51 NOTICE: (19)  : bisync resync
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:51 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:51 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:51 INFO  : Resync updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (20)  : test 7. run normal sync with check-sync enabled (default)
2024/11/07 01:18:51 NOTICE: (21)  : bisync
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:51 INFO  : Path1 checking for diffs
2024/11/07 01:18:51 INFO  : Path2 checking for diffs
2024/11/07 01:18:51 INFO  : No changes found
2024/11/07 01:18:51 INFO  : Updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (22)  : test 8. run normal sync with no-check-sync
2024/11/07 01:18:51 NOTICE: (23)  : bisync no-check-sync
2024/11/07 01:18:51 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/check_sync/path2/"
2024/11/07 01:18:51 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:51 INFO  : Path1 checking for diffs
2024/11/07 01:18:51 INFO  : Path2 checking for diffs
2024/11/07 01:18:51 INFO  : No changes found
2024/11/07 01:18:51 INFO  : Updating listings
2024/11/07 01:18:51 INFO  : Bisync successful
    bisync_test.go:558: TEST check_sync PASSED
=== RUN   TestBisyncLocalRemote/compare_all
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/compare_all/path1"
2024/11/07 01:18:51 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:51 DEBUG : path2: Making directory
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:51 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/compare_all/path2"
2024/11/07 01:18:51 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:51 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:51 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:51 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:51 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2"
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_compare_all-sefozal8"
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/initdir/test_compare_all-sefozal8: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/initdir/test_compare_all-sefozal8: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:51 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:51 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:51 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:51 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_compare_all-kemabib3"
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:51 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:51 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:51 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/datadir/test_compare_all-kemabib3: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/datadir/test_compare_all-kemabib3: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:51 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:51 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:51 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:51 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:51 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:51 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:51 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:51 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:51 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 ERROR : : error listing: directory not found
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: list [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2]
2024/11/07 01:18:51 ERROR : : error listing: directory not found
2024/11/07 01:18:51 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_compare_all-sefozal8
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/compare_all/path1: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:51 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:51 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:51 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:51 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : Local file system at /tmp/011847xi/compare_all/path1: Waiting for transfers to finish
2024/11/07 01:18:51 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:51 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:51 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: checking Path1 Local file system at /tmp/011847xi/compare_all/path1
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: list [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2]
2024/11/07 01:18:51 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/RCLONE_TEST]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file1.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file2.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: Waiting for checks to finish
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file3.txt]
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: Waiting for transfers to finish
2024/11/07 01:18:51 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file4.txt]
2024/11/07 01:18:51 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file5.txt]
2024/11/07 01:18:51 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file6.txt]
2024/11/07 01:18:51 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file7.txt]
2024/11/07 01:18:51 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: update [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file8.txt]
2024/11/07 01:18:51 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:51 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2
2024/11/07 01:18:51 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/compare_all/path2: list [/rclone-test-zedewoz4gosi/011847xi/compare_all/path2]
2024/11/07 01:18:51 NOTICE: (01)  : test changes compare-all
2024/11/07 01:18:51 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:51 NOTICE: (03)  : bisync resync compare-all
2024/11/07 01:18:51 NOTICE: Local file system at /tmp/011847xi/compare_all/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:51 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:51 INFO  : Synching Path1 "/tmp/011847xi/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/"
2024/11/07 01:18:51 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:51 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:51 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:51 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:51 INFO  : Resync updating listings
2024/11/07 01:18:51 INFO  : Validating listings for Path1 "/tmp/011847xi/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/"
2024/11/07 01:18:51 INFO  : Bisync successful
2024/11/07 01:18:51 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:18:51 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:18:51 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/
2024/11/07 01:18:51 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: (07)  : test newer on path2 - file1
2024/11/07 01:18:51 NOTICE: (08)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/
2024/11/07 01:18:51 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:51 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:18:51 NOTICE: (10)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/file11.txt /tmp/011847xi/compare_all/path1/
2024/11/07 01:18:51 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:51 NOTICE: (11)  : test newer on path1 - file2
2024/11/07 01:18:51 NOTICE: (12)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/file2.txt /tmp/011847xi/compare_all/path1/
2024/11/07 01:18:51 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:51 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:18:51 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file3.txt
2024/11/07 01:18:51 INFO  : file3.txt: Deleted
2024/11/07 01:18:51 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:18:51 NOTICE: (16)  : delete-file /tmp/011847xi/compare_all/path1/file4.txt
2024/11/07 01:18:51 INFO  : file4.txt: Deleted
2024/11/07 01:18:51 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:18:51 NOTICE: (18)  : delete-file /tmp/011847xi/compare_all/path1/file8.txt
2024/11/07 01:18:51 INFO  : file8.txt: Deleted
2024/11/07 01:18:51 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file8.txt
2024/11/07 01:18:51 INFO  : file8.txt: Deleted
2024/11/07 01:18:51 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:18:51 NOTICE: (21)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/ file5R.txt
2024/11/07 01:18:51 NOTICE: (22)  : copy-as /tmp/011847xi/datadir/test_compare_all-kemabib3/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/ file5.txt
2024/11/07 01:18:52 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:52 NOTICE: (23)  : touch-glob 2001-03-04 /tmp/011847xi/datadir/test_compare_all-kemabib3/ file5L.txt
2024/11/07 01:18:52 NOTICE: (24)  : copy-as /tmp/011847xi/datadir/test_compare_all-kemabib3/file5L.txt /tmp/011847xi/compare_all/path1/ file5.txt
2024/11/07 01:18:52 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:52 NOTICE: (25)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:18:52 NOTICE: (26)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/
2024/11/07 01:18:52 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:52 NOTICE: (27)  : delete-file /tmp/011847xi/compare_all/path1/file6.txt
2024/11/07 01:18:52 INFO  : file6.txt: Deleted
2024/11/07 01:18:52 NOTICE: (28)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:18:52 NOTICE: (29)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_compare_all-kemabib3/file7.txt /tmp/011847xi/compare_all/path1/
2024/11/07 01:18:52 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:52 NOTICE: (30)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file7.txt
2024/11/07 01:18:52 INFO  : file7.txt: Deleted
2024/11/07 01:18:52 NOTICE: (31)  : test bisync run
2024/11/07 01:18:52 NOTICE: (32)  : bisync compare-all
2024/11/07 01:18:52 NOTICE: Local file system at /tmp/011847xi/compare_all/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/"
2024/11/07 01:18:52 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:52 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:52 INFO  : Path1 checking for diffs
2024/11/07 01:18:52 INFO  : - Path1    File changed: size (larger), time (newer), hash - file2.txt
2024/11/07 01:18:52 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:52 INFO  : - Path1    File changed: size (larger), time (newer), hash - file5.txt
2024/11/07 01:18:52 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:52 INFO  : - Path1    File changed: size (larger), time (newer), hash - file7.txt
2024/11/07 01:18:52 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:18:52 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:52 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:52 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:52 INFO  : Path2 checking for diffs
2024/11/07 01:18:52 INFO  : - Path2    File changed: size (larger), time (newer), hash - file1.txt
2024/11/07 01:18:52 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:52 INFO  : - Path2    File changed: size (larger), time (newer), hash - file5.txt
2024/11/07 01:18:52 INFO  : - Path2    File changed: size (larger), time (newer), hash - file6.txt
2024/11/07 01:18:52 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:52 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:18:52 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:52 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:52 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:52 INFO  : Applying changes
2024/11/07 01:18:52 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file11.txt
2024/11/07 01:18:52 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file2.txt
2024/11/07 01:18:52 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file4.txt
2024/11/07 01:18:52 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:52 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/compare_all/path1/file5.txt.conflict1
2024/11/07 01:18:52 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:52 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file5.txt.conflict1
2024/11/07 01:18:52 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file5.txt.conflict2
2024/11/07 01:18:52 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:52 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/compare_all/path1/file5.txt.conflict2
2024/11/07 01:18:52 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/compare_all/path1/file6.txt
2024/11/07 01:18:52 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/file7.txt
2024/11/07 01:18:52 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/compare_all/path1/file1.txt
2024/11/07 01:18:52 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/compare_all/path1/file10.txt
2024/11/07 01:18:52 INFO  : - Path1    Queue delete              - /tmp/011847xi/compare_all/path1/file3.txt
2024/11/07 01:18:52 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:52 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:52 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file3.txt: Deleted
2024/11/07 01:18:52 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:52 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:52 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file4.txt: Deleted
2024/11/07 01:18:52 INFO  : Updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/compare_all/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
    bisync_test.go:558: TEST compare_all PASSED
=== RUN   TestBisyncLocalRemote/createemptysrcdirs
2024/11/07 01:18:52 DEBUG : Creating backend with remote "/tmp/011847xi/createemptysrcdirs/path1"
2024/11/07 01:18:52 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:52 DEBUG : path2: Making directory
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:52 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2"
2024/11/07 01:18:52 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:52 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:52 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2"
2024/11/07 01:18:52 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_createemptysrcdirs-xehabay9"
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/initdir/test_createemptysrcdirs-xehabay9: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/initdir/test_createemptysrcdirs-xehabay9: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:52 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:52 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:52 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:52 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:52 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:52 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5"
2024/11/07 01:18:52 DEBUG : placeholder.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : placeholder.txt.4db661ca.partial: renamed to: placeholder.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new)
2024/11/07 01:18:52 ERROR : : error listing: directory not found
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2]
2024/11/07 01:18:52 ERROR : : error listing: directory not found
2024/11/07 01:18:52 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_createemptysrcdirs-xehabay9
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:52 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:52 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:52 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:52 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/createemptysrcdirs/path1: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:52 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/createemptysrcdirs/path1: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:52 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:52 NOTICE: checking Path1 Local file system at /tmp/011847xi/createemptysrcdirs/path1
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2]
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/RCLONE_TEST]
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/file1.copy1.txt]
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/file1.copy2.txt]
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/file1.copy3.txt]
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/file1.copy4.txt]
2024/11/07 01:18:52 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/file1.copy5.txt]
2024/11/07 01:18:52 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/file1.txt]
2024/11/07 01:18:52 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2]
2024/11/07 01:18:52 NOTICE: (01)  : test createemptysrcdirs
2024/11/07 01:18:52 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:52 NOTICE: (03)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/ placeholder.txt
2024/11/07 01:18:52 NOTICE: (04)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Updated modification time in destination
2024/11/07 01:18:52 NOTICE: (05)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Updated modification time in destination
2024/11/07 01:18:52 NOTICE: (06)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Updated modification time in destination
2024/11/07 01:18:52 NOTICE: (07)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Updated modification time in destination
2024/11/07 01:18:52 NOTICE: (08)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Updated modification time in destination
2024/11/07 01:18:52 NOTICE: (09)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Updated modification time in destination
2024/11/07 01:18:52 NOTICE: (10)  : bisync resync
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:52 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:52 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:52 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:52 INFO  : Resync updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (11)  : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder
2024/11/07 01:18:52 NOTICE: (12)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ subdir/placeholder.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: subdir/placeholder.txt
2024/11/07 01:18:52 NOTICE: (13)  : touch-glob 2001-01-02 /tmp/011847xi/createemptysrcdirs/path1/ subdir
2024/11/07 01:18:52 NOTICE: (14)  : delete-file /tmp/011847xi/createemptysrcdirs/path1/subdir/placeholder.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Deleted
2024/11/07 01:18:52 NOTICE: (15)  : test 2. Run bisync without --create-empty-src-dirs
2024/11/07 01:18:52 NOTICE: (16)  : bisync
2024/11/07 01:18:52 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:52 INFO  : Path1 checking for diffs
2024/11/07 01:18:52 INFO  : Path2 checking for diffs
2024/11/07 01:18:52 INFO  : No changes found
2024/11/07 01:18:52 INFO  : Updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (17)  : test 3. Confirm the subdir exists only on Path1 and not Path2
2024/11/07 01:18:52 NOTICE: (18)  : list-dirs /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (19)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/
2024/11/07 01:18:52 NOTICE: (20)  : test 4.Run bisync WITH --create-empty-src-dirs
2024/11/07 01:18:52 NOTICE: (21)  : bisync create-empty-src-dirs
2024/11/07 01:18:52 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:52 INFO  : Path1 checking for diffs
2024/11/07 01:18:52 INFO  : - Path1    File is new               - subdir
2024/11/07 01:18:52 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:52 INFO  : Path2 checking for diffs
2024/11/07 01:18:52 INFO  : Applying changes
2024/11/07 01:18:52 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/subdir
2024/11/07 01:18:52 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:52 INFO  : Updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (22)  : test 5. Confirm the subdir exists on both paths
2024/11/07 01:18:52 NOTICE: (23)  : list-dirs /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (24)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (25)  : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty)
2024/11/07 01:18:52 NOTICE: (26)  : purge-children /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 INFO  : subdir: Removing directory
2024/11/07 01:18:52 NOTICE: (27)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.txt
2024/11/07 01:18:52 NOTICE: (28)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy1.txt
2024/11/07 01:18:52 NOTICE: (29)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy2.txt
2024/11/07 01:18:52 NOTICE: (30)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy3.txt
2024/11/07 01:18:52 NOTICE: (31)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy4.txt
2024/11/07 01:18:52 NOTICE: (32)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy5.txt
2024/11/07 01:18:52 NOTICE: (33)  : test 7. Run bisync without --create-empty-src-dirs
2024/11/07 01:18:52 NOTICE: (34)  : bisync
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:52 INFO  : Path1 checking for diffs
2024/11/07 01:18:52 INFO  : - Path1    File was deleted          - RCLONE_TEST
2024/11/07 01:18:52 INFO  : - Path1    File was deleted          - subdir
2024/11/07 01:18:52 INFO  : Path1:    2 changes:    0 new,    0 modified,    2 deleted
2024/11/07 01:18:52 INFO  : Path2 checking for diffs
2024/11/07 01:18:52 INFO  : - Path2    File was deleted          - subdir
2024/11/07 01:18:52 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:52 INFO  : Applying changes
2024/11/07 01:18:52 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/RCLONE_TEST
2024/11/07 01:18:52 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:18:52 INFO  : Updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (35)  : test 8. Confirm the subdir exists only on Path2 and not Path1
2024/11/07 01:18:52 NOTICE: (36)  : list-dirs /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 NOTICE: (37)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (38)  : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs
2024/11/07 01:18:52 NOTICE: (39)  : bisync resync create-empty-src-dirs
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:52 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:52 INFO  : subdir: Made directory with metadata (mtime=2024-11-07T01:18:52.563Z)
2024/11/07 01:18:52 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:52 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:52 INFO  : Resync updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (40)  : list-dirs /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (41)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (42)  : purge-children /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 INFO  : subdir: Removing directory
2024/11/07 01:18:52 NOTICE: (43)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.txt
2024/11/07 01:18:52 NOTICE: (44)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy1.txt
2024/11/07 01:18:52 NOTICE: (45)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy2.txt
2024/11/07 01:18:52 NOTICE: (46)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy3.txt
2024/11/07 01:18:52 NOTICE: (47)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy4.txt
2024/11/07 01:18:52 NOTICE: (48)  : copy-as /tmp/011847xi/datadir/test_createemptysrcdirs-besiyos5/placeholder.txt /tmp/011847xi/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:18:52 INFO  : placeholder.txt: Copied (new) to: file1.copy5.txt
2024/11/07 01:18:52 NOTICE: (49)  : list-dirs /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 NOTICE: (50)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/
2024/11/07 01:18:52 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:52 NOTICE: (51)  : bisync create-empty-src-dirs
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:52 INFO  : Path1 checking for diffs
2024/11/07 01:18:52 INFO  : - Path1    File was deleted          - subdir
2024/11/07 01:18:52 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:52 INFO  : Path2 checking for diffs
2024/11/07 01:18:52 INFO  : Applying changes
2024/11/07 01:18:52 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/subdir
2024/11/07 01:18:52 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:52 INFO  : subdir: Removing directory
2024/11/07 01:18:52 INFO  : Updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (52)  : test 10. Confirm the subdir has been removed on both paths
2024/11/07 01:18:52 NOTICE: (53)  : list-dirs /tmp/011847xi/createemptysrcdirs/path1/
2024/11/07 01:18:52 NOTICE: (54)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/
2024/11/07 01:18:52 NOTICE: (55)  : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime)
2024/11/07 01:18:52 NOTICE: (56)  : bisync create-empty-src-dirs
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:52 INFO  : Path1 checking for diffs
2024/11/07 01:18:52 INFO  : Path2 checking for diffs
2024/11/07 01:18:52 INFO  : No changes found
2024/11/07 01:18:52 INFO  : Updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/createemptysrcdirs/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
    bisync_test.go:558: TEST createemptysrcdirs PASSED
=== RUN   TestBisyncLocalRemote/dry_run
2024/11/07 01:18:52 DEBUG : Creating backend with remote "/tmp/011847xi/dry_run/path1"
2024/11/07 01:18:52 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:52 DEBUG : path2: Making directory
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:52 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/dry_run/path2"
2024/11/07 01:18:52 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:52 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:52 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:52 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:52 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/dry_run/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2"
2024/11/07 01:18:52 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_dry_run-veyiwos7"
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/initdir/test_dry_run-veyiwos7: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:52 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:52 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:52 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:52 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:52 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/initdir/test_dry_run-veyiwos7: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:52 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:52 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:52 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_dry_run-kecayam3"
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:52 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/datadir/test_dry_run-kecayam3: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/datadir/test_dry_run-kecayam3: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:52 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:18:52 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:52 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:18:52 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:52 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:52 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:52 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:18:52 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:52 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:18:52 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:52 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:52 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:52 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:18:52 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:52 ERROR : : error listing: directory not found
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: list [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2]
2024/11/07 01:18:52 ERROR : : error listing: directory not found
2024/11/07 01:18:52 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_dry_run-veyiwos7
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/dry_run/path1: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : Local file system at /tmp/011847xi/dry_run/path1: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:52 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:52 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:52 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:52 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:52 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:52 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:52 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:52 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:52 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:52 NOTICE: checking Path1 Local file system at /tmp/011847xi/dry_run/path1
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: list [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2]
2024/11/07 01:18:52 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/RCLONE_TEST]
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: Waiting for checks to finish
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: Waiting for transfers to finish
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file1.txt]
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file2.txt]
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file3.txt]
2024/11/07 01:18:52 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file4.txt]
2024/11/07 01:18:52 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file5.txt]
2024/11/07 01:18:52 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file6.txt]
2024/11/07 01:18:52 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: update [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file7.txt]
2024/11/07 01:18:52 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:52 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:52 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2
2024/11/07 01:18:52 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: list [/rclone-test-zedewoz4gosi/011847xi/dry_run/path2]
2024/11/07 01:18:52 NOTICE: (01)  : test dry-run
2024/11/07 01:18:52 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:52 NOTICE: (03)  : bisync resync
2024/11/07 01:18:52 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:52 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:52 INFO  : Synching Path1 "/tmp/011847xi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/"
2024/11/07 01:18:52 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:52 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:52 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:52 INFO  : Resync updating listings
2024/11/07 01:18:52 INFO  : Validating listings for Path1 "/tmp/011847xi/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/"
2024/11/07 01:18:52 INFO  : Bisync successful
2024/11/07 01:18:52 NOTICE: (04)  : test new on path2 - file10
2024/11/07 01:18:52 NOTICE: (05)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/dry_run/path2/
2024/11/07 01:18:52 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:52 NOTICE: (06)  : test newer on path2 - file1
2024/11/07 01:18:52 NOTICE: (07)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/dry_run/path2/
2024/11/07 01:18:52 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:52 NOTICE: (08)  : test new on path1 - file11
2024/11/07 01:18:52 NOTICE: (09)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/file11.txt /tmp/011847xi/dry_run/path1/
2024/11/07 01:18:52 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:52 NOTICE: (10)  : test newer on path1 - file2
2024/11/07 01:18:52 NOTICE: (11)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/file2.txt /tmp/011847xi/dry_run/path1/
2024/11/07 01:18:52 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:52 NOTICE: (12)  : test deleted on path2 - file3
2024/11/07 01:18:52 NOTICE: (13)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file3.txt
2024/11/07 01:18:52 INFO  : file3.txt: Deleted
2024/11/07 01:18:52 NOTICE: (14)  : test deleted on path1 - file4
2024/11/07 01:18:52 NOTICE: (15)  : delete-file /tmp/011847xi/dry_run/path1/file4.txt
2024/11/07 01:18:52 INFO  : file4.txt: Deleted
2024/11/07 01:18:52 NOTICE: (16)  : test changed on path2 and on path1 - file5 (file5R, file5L)
2024/11/07 01:18:52 NOTICE: (17)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/ file5R.txt
2024/11/07 01:18:52 NOTICE: (18)  : copy-as /tmp/011847xi/datadir/test_dry_run-kecayam3/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/dry_run/path2/ file5.txt
2024/11/07 01:18:53 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:53 NOTICE: (19)  : touch-glob 2001-03-04 /tmp/011847xi/datadir/test_dry_run-kecayam3/ file5L.txt
2024/11/07 01:18:53 NOTICE: (20)  : copy-as /tmp/011847xi/datadir/test_dry_run-kecayam3/file5L.txt /tmp/011847xi/dry_run/path1/ file5.txt
2024/11/07 01:18:53 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:53 NOTICE: (21)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:18:53 NOTICE: (22)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/dry_run/path2/
2024/11/07 01:18:53 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:53 NOTICE: (23)  : delete-file /tmp/011847xi/dry_run/path1/file6.txt
2024/11/07 01:18:53 INFO  : file6.txt: Deleted
2024/11/07 01:18:53 NOTICE: (24)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:18:53 NOTICE: (25)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_dry_run-kecayam3/file7.txt /tmp/011847xi/dry_run/path1/
2024/11/07 01:18:53 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:53 NOTICE: (26)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file7.txt
2024/11/07 01:18:53 INFO  : file7.txt: Deleted
2024/11/07 01:18:53 NOTICE: (27)  : test sync with dry-run and resync
2024/11/07 01:18:53 NOTICE: (28)  : bisync dry-run resync
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/"
2024/11/07 01:18:53 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:53 NOTICE: - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:53 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:18:53 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:53 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:18:53 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13)
2024/11/07 01:18:53 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:18:53 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39)
2024/11/07 01:18:53 INFO  : Resync updating listings
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (29)  : copy-listings dryrun-resync
2024/11/07 01:18:53 NOTICE: (30)  : test sync with dry-run
2024/11/07 01:18:53 NOTICE: (31)  : bisync dry-run
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/"
2024/11/07 01:18:53 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:53 INFO  : Path1 checking for diffs
2024/11/07 01:18:53 NOTICE: - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:53 NOTICE: - Path1    File was deleted          - file4.txt
2024/11/07 01:18:53 NOTICE: - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:53 NOTICE: - Path1    File was deleted          - file6.txt
2024/11/07 01:18:53 NOTICE: - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:18:53 NOTICE: - Path1    File is new               - file11.txt
2024/11/07 01:18:53 INFO  : Path1:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:53 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:53 INFO  : Path2 checking for diffs
2024/11/07 01:18:53 NOTICE: - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:53 NOTICE: - Path2    File was deleted          - file3.txt
2024/11/07 01:18:53 NOTICE: - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:53 NOTICE: - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:18:53 NOTICE: - Path2    File was deleted          - file7.txt
2024/11/07 01:18:53 NOTICE: - Path2    File is new               - file10.txt
2024/11/07 01:18:53 INFO  : Path2:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:53 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:53 INFO  : Applying changes
2024/11/07 01:18:53 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:53 INFO  : Checking potential conflicts...
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: 1 differences found
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: 1 errors while checking
2024/11/07 01:18:53 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:53 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file11.txt
2024/11/07 01:18:53 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file2.txt
2024/11/07 01:18:53 NOTICE: - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file4.txt
2024/11/07 01:18:53 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:53 NOTICE: file5.txt: Skipped rename as --dry-run is set
2024/11/07 01:18:53 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file5.txt.conflict1
2024/11/07 01:18:53 NOTICE: file5.txt: Skipped rename as --dry-run is set
2024/11/07 01:18:53 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file5.txt.conflict2
2024/11/07 01:18:53 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file6.txt
2024/11/07 01:18:53 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file7.txt
2024/11/07 01:18:53 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file1.txt
2024/11/07 01:18:53 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file10.txt
2024/11/07 01:18:53 NOTICE: - Path1    Queue delete              - /tmp/011847xi/dry_run/path1/file3.txt
2024/11/07 01:18:53 NOTICE: - Path2    Do queued copies to                - Path1
2024/11/07 01:18:53 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0)
2024/11/07 01:18:53 NOTICE: - Path1    Do queued copies to                - Path2
2024/11/07 01:18:53 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13)
2024/11/07 01:18:53 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:18:53 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0)
2024/11/07 01:18:53 INFO  : Updating listings
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (32)  : copy-listings dryrun
2024/11/07 01:18:53 NOTICE: (33)  : test sync without dry-run
2024/11/07 01:18:53 NOTICE: (34)  : bisync
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/"
2024/11/07 01:18:53 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:53 INFO  : Path1 checking for diffs
2024/11/07 01:18:53 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:53 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:53 INFO  : - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:53 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:53 INFO  : - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:18:53 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:53 INFO  : Path1:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:53 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:53 INFO  : Path2 checking for diffs
2024/11/07 01:18:53 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:53 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:53 INFO  : - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:18:53 INFO  : - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:18:53 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:53 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:53 INFO  : Path2:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:18:53 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:18:53 INFO  : Applying changes
2024/11/07 01:18:53 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:53 INFO  : Checking potential conflicts...
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: 1 differences found
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/dry_run/path2: 1 errors while checking
2024/11/07 01:18:53 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:53 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file11.txt
2024/11/07 01:18:53 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file2.txt
2024/11/07 01:18:53 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file4.txt
2024/11/07 01:18:53 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:53 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/dry_run/path1/file5.txt.conflict1
2024/11/07 01:18:53 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:53 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file5.txt.conflict1
2024/11/07 01:18:53 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file5.txt.conflict2
2024/11/07 01:18:53 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:53 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file5.txt.conflict2
2024/11/07 01:18:53 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file6.txt
2024/11/07 01:18:53 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/file7.txt
2024/11/07 01:18:53 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file1.txt
2024/11/07 01:18:53 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/dry_run/path1/file10.txt
2024/11/07 01:18:53 INFO  : - Path1    Queue delete              - /tmp/011847xi/dry_run/path1/file3.txt
2024/11/07 01:18:53 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:53 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:53 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:53 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:53 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:53 INFO  : file3.txt: Deleted
2024/11/07 01:18:53 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:53 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:53 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:53 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:53 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:53 INFO  : file4.txt: Deleted
2024/11/07 01:18:53 INFO  : Updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/dry_run/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
    bisync_test.go:558: TEST dry_run PASSED
=== RUN   TestBisyncLocalRemote/equal
2024/11/07 01:18:53 DEBUG : Creating backend with remote "/tmp/011847xi/equal/path1"
2024/11/07 01:18:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:53 DEBUG : path2: Making directory
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/equal/path2"
2024/11/07 01:18:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/equal/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2"
2024/11/07 01:18:53 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_equal-vimones8"
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/initdir/test_equal-vimones8: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/initdir/test_equal-vimones8: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:53 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:53 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_equal-qohodof4"
2024/11/07 01:18:53 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/datadir/test_equal-qohodof4: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/datadir/test_equal-qohodof4: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK
2024/11/07 01:18:53 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:18:53 DEBUG : file1R.txt.c0691a20.partial: renamed to: file1R.txt
2024/11/07 01:18:53 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:18:53 DEBUG : file2.txt.fbf6b964.partial: renamed to: file2.txt
2024/11/07 01:18:53 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:53 INFO  : file1R.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : file1L.txt.a9dc541c.partial: renamed to: file1L.txt
2024/11/07 01:18:53 INFO  : file1L.txt: Copied (new)
2024/11/07 01:18:53 ERROR : : error listing: directory not found
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: list [/rclone-test-zedewoz4gosi/011847xi/equal/path2]
2024/11/07 01:18:53 ERROR : : error listing: directory not found
2024/11/07 01:18:53 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_equal-vimones8
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:53 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:53 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:53 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:53 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/equal/path1: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/equal/path1: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 NOTICE: checking Path1 Local file system at /tmp/011847xi/equal/path1
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: list [/rclone-test-zedewoz4gosi/011847xi/equal/path2]
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: update [/rclone-test-zedewoz4gosi/011847xi/equal/path2/RCLONE_TEST]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: update [/rclone-test-zedewoz4gosi/011847xi/equal/path2/file1.txt]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: update [/rclone-test-zedewoz4gosi/011847xi/equal/path2/file2.txt]
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:53 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:53 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: list [/rclone-test-zedewoz4gosi/011847xi/equal/path2]
2024/11/07 01:18:53 NOTICE: (01)  : test equal
2024/11/07 01:18:53 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:53 NOTICE: (03)  : bisync resync
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2/"
2024/11/07 01:18:53 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:53 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:53 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:53 INFO  : Resync updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (04)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:53 NOTICE: (05)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_equal-qohodof4/ file1R.txt
2024/11/07 01:18:53 NOTICE: (06)  : copy-as /tmp/011847xi/datadir/test_equal-qohodof4/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/equal/path2/ file1.txt
2024/11/07 01:18:53 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:53 NOTICE: (07)  : touch-glob 2001-03-04 /tmp/011847xi/datadir/test_equal-qohodof4/ file1L.txt
2024/11/07 01:18:53 NOTICE: (08)  : copy-as /tmp/011847xi/datadir/test_equal-qohodof4/file1L.txt /tmp/011847xi/equal/path1/ file1.txt
2024/11/07 01:18:53 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:53 NOTICE: (09)  : test changed on both paths and identical - file2
2024/11/07 01:18:53 NOTICE: (10)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_equal-qohodof4/ file2.txt
2024/11/07 01:18:53 NOTICE: (11)  : copy-as /tmp/011847xi/datadir/test_equal-qohodof4/file2.txt /tmp/011847xi/equal/path1/ file2.txt
2024/11/07 01:18:53 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:53 NOTICE: (12)  : copy-as /tmp/011847xi/datadir/test_equal-qohodof4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/equal/path2/ file2.txt
2024/11/07 01:18:53 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:53 NOTICE: (13)  : test bisync run
2024/11/07 01:18:53 NOTICE: (14)  : bisync
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2/"
2024/11/07 01:18:53 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:53 INFO  : Path1 checking for diffs
2024/11/07 01:18:53 INFO  : - Path1    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:53 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:53 INFO  : Path1:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:53 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:18:53 INFO  : Path2 checking for diffs
2024/11/07 01:18:53 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:53 INFO  : - Path2    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:53 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:53 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:18:53 INFO  : Applying changes
2024/11/07 01:18:53 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:53 INFO  : Checking potential conflicts...
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: 1 differences found
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: 1 errors while checking
2024/11/07 01:18:53 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/equal/path2: 1 matching files
2024/11/07 01:18:53 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:53 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:53 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/equal/path1/file1.txt.conflict1
2024/11/07 01:18:53 INFO  : file1.txt: Moved (server-side) to: file1.txt.conflict1
2024/11/07 01:18:53 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2/file1.txt.conflict1
2024/11/07 01:18:53 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2/file1.txt.conflict2
2024/11/07 01:18:53 INFO  : file1.txt: Moved (server-side) to: file1.txt.conflict2
2024/11/07 01:18:53 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/equal/path1/file1.txt.conflict2
2024/11/07 01:18:53 NOTICE: - WARNING  New or changed in both paths       - file2.txt
2024/11/07 01:18:53 INFO  : Files are equal! Skipping: file2.txt
2024/11/07 01:18:53 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:53 INFO  : file1.txt.conflict2: Copied (new)
2024/11/07 01:18:53 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:53 INFO  : file1.txt.conflict1: Copied (new)
2024/11/07 01:18:53 INFO  : Updating listings
2024/11/07 01:18:53 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:53 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/equal/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
    bisync_test.go:558: TEST equal PASSED
=== RUN   TestBisyncLocalRemote/ext_paths
2024/11/07 01:18:53 DEBUG : Creating backend with remote "/tmp/011847xi/ext_paths/path1"
2024/11/07 01:18:53 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:53 DEBUG : path2: Making directory
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:53 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2"
2024/11/07 01:18:53 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:53 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:53 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:53 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:53 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2"
2024/11/07 01:18:53 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_ext_paths-saladuh5"
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ: Making directory with metadata
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z)
2024/11/07 01:18:53 DEBUG : Added delayed dir = "測試Ру��кий  ěáñ", newDst=測試Ру��кий  ěáñ
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/initdir/test_ext_paths-saladuh5: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/initdir/test_ext_paths-saladuh5: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:53 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:53 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:53 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:53 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:53 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : 測試_check file.5028a97.partial: renamed to: 測試_check file
2024/11/07 01:18:53 INFO  : 測試_check file: Copied (new)
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:53 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file.5028a97.partial: renamed to: 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_ext_paths-fosapos6"
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/datadir/test_ext_paths-fosapos6: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/datadir/test_ext_paths-fosapos6: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:53 DEBUG : file1.txt.917a74a1.partial: renamed to: file1.txt
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:18:53 DEBUG : 測試_filtersfile.txt.1c47c956.partial: renamed to: 測試_filtersfile.txt
2024/11/07 01:18:53 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:18:53 ERROR : : error listing: directory not found
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: list [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2]
2024/11/07 01:18:53 ERROR : : error listing: directory not found
2024/11/07 01:18:53 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_ext_paths-saladuh5
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ: Making directory with metadata
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z)
2024/11/07 01:18:53 DEBUG : Added delayed dir = "測試Ру��кий  ěáñ", newDst=測試Ру��кий  ěáñ
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:53 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/ext_paths/path1: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : Local file system at /tmp/011847xi/ext_paths/path1: Waiting for transfers to finish
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:53 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:53 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:53 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:53 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:53 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : 測試_check file.5028a97.partial: renamed to: 測試_check file
2024/11/07 01:18:53 INFO  : 測試_check file: Copied (new)
2024/11/07 01:18:53 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file.5028a97.partial: renamed to: 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 NOTICE: checking Path1 Local file system at /tmp/011847xi/ext_paths/path1
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: list [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2]
2024/11/07 01:18:53 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ: Making directory
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/RCLONE_TEST]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/file1.txt]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/file_enconde_mañana_funcionará.txt]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/filename_contains_ě_.txt]
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: Waiting for checks to finish
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: Waiting for transfers to finish
2024/11/07 01:18:53 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/filename_contains_ࢺ_.txt]
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/Ру��кий.txt]
2024/11/07 01:18:53 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試_check file]
2024/11/07 01:18:53 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/filename_contains_ě_.txt]
2024/11/07 01:18:53 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt]
2024/11/07 01:18:53 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: update [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/測試_check file]
2024/11/07 01:18:53 INFO  : 測試_check file: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:53 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: list [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2]
2024/11/07 01:18:53 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2: list [/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ]
2024/11/07 01:18:53 NOTICE: (01)  : test extended-char-paths
2024/11/07 01:18:53 NOTICE: (02)  : fix-names /tmp/011847xi/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/
2024/11/07 01:18:53 ERROR : Local file system at /tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-nolokiy3: Server side directory move failed: rename /tmp/011847xi/ext_paths/path1/測試Ру��кий  ěa�ñ /tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-nolokiy3: no such file or directory
2024/11/07 01:18:53 INFO  : Local file system at /tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists
2024/11/07 01:18:53 ERROR : Local file system at /tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-nolokiy3: error reading source root directory: directory not found
2024/11/07 01:18:53 NOTICE: (03)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/
2024/11/07 01:18:53 ERROR : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-mogadeq5: Server side directory move failed: rename /rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěa�ñ: file does not exist
2024/11/07 01:18:53 INFO  : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists
2024/11/07 01:18:53 ERROR : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-mogadeq5: error reading source root directory: directory not found
2024/11/07 01:18:53 NOTICE: (04)  : fix-names /tmp/011847xi/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:53 NOTICE: (05)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:53 NOTICE: (06)  : fix-names /tmp/011847xi/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:53 NOTICE: (07)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/filename_contains_ě_.txt
2024/11/07 01:18:53 NOTICE: (08)  : fix-names /tmp/011847xi/ext_paths/path1/測試_check{spc}file
2024/11/07 01:18:53 NOTICE: (09)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試_check{spc}file
2024/11/07 01:18:53 NOTICE: (10)  : fix-names /tmp/011847xi/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:53 NOTICE: (11)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:53 NOTICE: (12)  : test resync subdirs with extended chars
2024/11/07 01:18:53 NOTICE: (13)  : bisync subdir=測試Ру��кий{spc}{spc}ěáñ resync
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:53 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:53 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:53 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:53 INFO  : Resync updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (14)  : copy-listings resync
2024/11/07 01:18:53 NOTICE: (15)  : test place new files with extended chars on each side
2024/11/07 01:18:53 NOTICE: (16)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_ext_paths-fosapos6/ file1.txt
2024/11/07 01:18:53 NOTICE: (17)  : copy-as /tmp/011847xi/datadir/test_ext_paths-fosapos6/file1.txt /tmp/011847xi/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ 測試_file1p1
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new) to: 測試_file1p1
2024/11/07 01:18:53 NOTICE: (18)  : copy-as /tmp/011847xi/datadir/test_ext_paths-fosapos6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ 測試_file1p2
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new) to: 測試_file1p2
2024/11/07 01:18:53 NOTICE: (19)  : test normal sync of subdirs with extended chars
2024/11/07 01:18:53 NOTICE: (20)  : bisync subdir=測試Ру��кий{spc}{spc}ěáñ
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:53 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:53 INFO  : Path1 checking for diffs
2024/11/07 01:18:53 INFO  : - Path1    File is new               - 測試_file1p1
2024/11/07 01:18:53 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:53 INFO  : Path2 checking for diffs
2024/11/07 01:18:53 INFO  : - Path2    File is new               - 測試_file1p2
2024/11/07 01:18:53 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:53 INFO  : Applying changes
2024/11/07 01:18:53 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/測試_file1p1
2024/11/07 01:18:53 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ/測試_file1p2
2024/11/07 01:18:53 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:53 INFO  : 測試_file1p2: Copied (new)
2024/11/07 01:18:53 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:53 INFO  : 測試_file1p1: Copied (new)
2024/11/07 01:18:53 INFO  : Updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/測試Ру��кий  ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (21)  : move-listings normal-sync
2024/11/07 01:18:53 NOTICE: (22)  : test check-filename with extended chars. check should fail.
2024/11/07 01:18:53 NOTICE: (23)  : bisync resync
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:53 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:53 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:53 INFO  : Resync updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (24)  : delete-file /tmp/011847xi/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:18:53 INFO  : 測試_check file: Deleted
2024/11/07 01:18:53 NOTICE: (25)  : bisync check-access check-filename=測試_check{spc}file
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:53 INFO  : Path1 checking for diffs
2024/11/07 01:18:53 INFO  : - Path1    File was deleted          - 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:53 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:53 INFO  : Path2 checking for diffs
2024/11/07 01:18:53 INFO  : Checking access health
2024/11/07 01:18:53 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file
2024/11/07 01:18:53 ERROR : -          Access test failed: Path2 file not found in Path1 - 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:18:53 ERROR : Bisync critical error: check file check failed
2024/11/07 01:18:53 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:53 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:53 NOTICE: (26)  : copy-listings check-access-fail
2024/11/07 01:18:53 NOTICE: (27)  : test check-filename with extended chars. check should pass.
2024/11/07 01:18:53 NOTICE: (28)  : bisync resync
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:53 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:53 INFO  : Resync updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (29)  : bisync check-access check-filename=測試_check{spc}file
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:53 INFO  : Path1 checking for diffs
2024/11/07 01:18:53 INFO  : Path2 checking for diffs
2024/11/07 01:18:53 INFO  : Checking access health
2024/11/07 01:18:53 INFO  : Found 2 matching "測試_check file" files on both paths
2024/11/07 01:18:53 INFO  : No changes found
2024/11/07 01:18:53 INFO  : Updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (30)  : move-listings check-access-pass
2024/11/07 01:18:53 NOTICE: (31)  : test filters-file path with extended chars - masks /fileZ.txt
2024/11/07 01:18:53 NOTICE: (32)  : copy-file /tmp/011847xi/datadir/test_ext_paths-fosapos6/測試_filtersfile.txt /tmp/011847xi/workdir/
2024/11/07 01:18:53 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:18:53 NOTICE: (33)  : bisync filters-file=/tmp/011847xi/workdir/測試_filtersfile.txt resync
2024/11/07 01:18:53 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:53 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:53 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:53 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Using filters file /tmp/011847xi/workdir/測試_filtersfile.txt
2024/11/07 01:18:53 INFO  : Storing filters file hash to /tmp/011847xi/workdir/測試_filtersfile.txt.md5
2024/11/07 01:18:53 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:53 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:53 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:53 INFO  : Resync updating listings
2024/11/07 01:18:53 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:53 INFO  : Bisync successful
2024/11/07 01:18:53 NOTICE: (34)  : copy-as /tmp/011847xi/datadir/test_ext_paths-fosapos6/file1.txt /tmp/011847xi/ext_paths/path1/ fileZ.txt
2024/11/07 01:18:53 INFO  : file1.txt: Copied (new) to: fileZ.txt
2024/11/07 01:18:53 NOTICE: (35)  : bisync filters-file=/tmp/011847xi/workdir/測試_filtersfile.txt
2024/11/07 01:18:54 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/測試_filtersfile.txt
2024/11/07 01:18:54 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:54 INFO  : Path1 checking for diffs
2024/11/07 01:18:54 INFO  : Path2 checking for diffs
2024/11/07 01:18:54 INFO  : No changes found
2024/11/07 01:18:54 INFO  : Updating listings
2024/11/07 01:18:54 INFO  : Validating listings for Path1 "/tmp/011847xi/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ext_paths/path2/"
2024/11/07 01:18:54 INFO  : Bisync successful
    bisync_test.go:558: TEST ext_paths PASSED
=== RUN   TestBisyncLocalRemote/extended_filenames
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/extended_filenames/path1"
2024/11/07 01:18:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:54 DEBUG : path2: Making directory
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2"
2024/11/07 01:18:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2"
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_extended_filenames-qunonap5"
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_: Making directory with metadata
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:54 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_
2024/11/07 01:18:54 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/initdir/test_extended_filenames-qunonap5: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/initdir/test_extended_filenames-qunonap5: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt.5028a97.partial: renamed to: file1 - Copy (2).txt
2024/11/07 01:18:54 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:54 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:54 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:54 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt.5028a97.partial: renamed to: file1 - Copy.txt
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:54 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:54 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_extended_filenames-xagejit8"
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/datadir/test_extended_filenames-xagejit8: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/datadir/test_extended_filenames-xagejit8: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK
2024/11/07 01:18:54 DEBUG : file2.txt.761be064.partial: renamed to: file2.txt
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:54 DEBUG : file1.txt.f73bbb59.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 ERROR : : error listing: directory not found
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: list [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2]
2024/11/07 01:18:54 ERROR : : error listing: directory not found
2024/11/07 01:18:54 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_extended_filenames-qunonap5
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_: Making directory with metadata
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:54 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_
2024/11/07 01:18:54 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/extended_filenames/path1: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/extended_filenames/path1: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt.5028a97.partial: renamed to: file1 - Copy (2).txt
2024/11/07 01:18:54 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:18:54 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:18:54 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:18:54 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt.5028a97.partial: renamed to: file1 - Copy.txt
2024/11/07 01:18:54 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:18:54 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 NOTICE: checking Path1 Local file system at /tmp/011847xi/extended_filenames/path1
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: list [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2]
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_: Making directory
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/subdir_with_ࢺ_]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/RCLONE_TEST]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/file1 - Copy (2).txt]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/file1 - Copy.txt]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/file1.txt]
2024/11/07 01:18:54 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: Waiting for transfers to finish
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/file_enconde_mañana_funcionará.txt]
2024/11/07 01:18:54 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/filename_contains_ě_.txt]
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/filename_contains_ࢺ_.txt]
2024/11/07 01:18:54 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/Ру��кий.txt]
2024/11/07 01:18:54 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt]
2024/11/07 01:18:54 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: update [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ࢺ_.txt]
2024/11/07 01:18:54 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:54 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:54 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: list [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2: list [/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/subdir_with_ࢺ_]
2024/11/07 01:18:54 NOTICE: (01)  : test extended-filenames
2024/11/07 01:18:54 NOTICE: (02)  : fix-names /tmp/011847xi/extended_filenames/path1/subdir_with_ࢺ_/
2024/11/07 01:18:54 NOTICE: (03)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/subdir_with_ࢺ_/
2024/11/07 01:18:54 NOTICE: (04)  : fix-names /tmp/011847xi/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:54 NOTICE: (05)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:18:54 NOTICE: (06)  : fix-names /tmp/011847xi/extended_filenames/path1/Ру��кий.txt
2024/11/07 01:18:54 NOTICE: (07)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/Ру��кий.txt
2024/11/07 01:18:54 NOTICE: (08)  : fix-names /tmp/011847xi/extended_filenames/path1/file_enconde_mañana_funcionará.txt
2024/11/07 01:18:54 NOTICE: (09)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2/file_enconde_mañana_funcionará.txt
2024/11/07 01:18:54 NOTICE: (10)  : test initial bisync
2024/11/07 01:18:54 NOTICE: (11)  : bisync resync
2024/11/07 01:18:54 NOTICE: Local file system at /tmp/011847xi/extended_filenames/path1: Replacing invalid UTF-8 characters in "ě\x81\xfe a�ñhࢺ_測試Ру�кийěa�ñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬e�ö"
2024/11/07 01:18:54 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:54 NOTICE: Local file system at /tmp/011847xi/extended_filenames/path1: Replacing invalid UTF-8 characters in "ě\x81\xfe áñhࢺ_測試Ру�кийěáñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö"
2024/11/07 01:18:54 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:18:54 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:54 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
    bisync_test.go:1024: Fs is incapable of running test as the paths produce different results, skipping: extended_filenames (path1: 
        file1 - Copy (2).txtfile1 - Copy (2).txt (BOTH) path2: 
        РуÑ�Ñ�кий.txtÄ›�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö (РуÑ�Ñ�кий.txtÄ›�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö))
         (fs1: Local file system at /tmp/011847xi/extended_filenames/path1 fs2: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/extended_filenames/path2) 
        @@ -1 +1 @@
        -file1 - Copy (2).txtfile1 - Copy (2).txt+РуÑ�Ñ�кий.txtÄ›�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö
=== RUN   TestBisyncLocalRemote/filters
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/filters/path1"
2024/11/07 01:18:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:54 DEBUG : path2: Making directory
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/filters/path2"
2024/11/07 01:18:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filters/path2"
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_filters-fotexog1"
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:54 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:54 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/initdir/test_filters-fotexog1: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/initdir/test_filters-fotexog1: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:54 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:54 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:54 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:54 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:54 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:54 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_filters-fopabuf6"
2024/11/07 01:18:54 DEBUG : fileZ.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/datadir/test_filters-fopabuf6: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/datadir/test_filters-fopabuf6: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:54 DEBUG : fileZ.txt.925c801f.partial: renamed to: fileZ.txt
2024/11/07 01:18:54 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:18:54 DEBUG : filtersfile.flt.9f8671d3.partial: renamed to: filtersfile.flt
2024/11/07 01:18:54 INFO  : filtersfile.flt: Copied (new)
2024/11/07 01:18:54 ERROR : : error listing: directory not found
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/filters/path2]
2024/11/07 01:18:54 ERROR : : error listing: directory not found
2024/11/07 01:18:54 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_filters-fotexog1
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:54 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:54 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:54 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/filters/path1: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/filters/path1: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:54 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:54 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:54 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:54 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:54 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:54 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 NOTICE: checking Path1 Local file system at /tmp/011847xi/filters/path1
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/filters/path2]
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir: Making directory
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/filters/path2/subdir]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/RCLONE_TEST]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file1.txt]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file2.txt]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file3.txt]
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: Waiting for transfers to finish
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file4.txt]
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file5.txt]
2024/11/07 01:18:54 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file6.txt]
2024/11/07 01:18:54 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/file7.txt]
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: update [/rclone-test-zedewoz4gosi/011847xi/filters/path2/subdir/file20.txt]
2024/11/07 01:18:54 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:54 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:54 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:54 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/filters/path2]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filters/path2: list [/rclone-test-zedewoz4gosi/011847xi/filters/path2/subdir]
2024/11/07 01:18:54 NOTICE: (01)  : test filters
2024/11/07 01:18:54 NOTICE: (02)  : copy-file /tmp/011847xi/datadir/test_filters-fopabuf6/filtersfile.flt /tmp/011847xi/workdir/
2024/11/07 01:18:54 INFO  : filtersfile.flt: Copied (new)
2024/11/07 01:18:54 NOTICE: (03)  : test resync to force building of the filters md5 hash
2024/11/07 01:18:54 NOTICE: (04)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.flt resync
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filters/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.flt
2024/11/07 01:18:54 INFO  : Storing filters file hash to /tmp/011847xi/workdir/filtersfile.flt.md5
2024/11/07 01:18:54 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:54 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:54 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:54 INFO  : Resync updating listings
2024/11/07 01:18:54 INFO  : Validating listings for Path1 "/tmp/011847xi/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filters/path2/"
2024/11/07 01:18:54 INFO  : Bisync successful
2024/11/07 01:18:54 NOTICE: (05)  : copy-listings resync
2024/11/07 01:18:54 NOTICE: (06)  : test place new files on the remote
2024/11/07 01:18:54 NOTICE: (07)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_filters-fopabuf6/ fileZ.txt
2024/11/07 01:18:54 NOTICE: (08)  : copy-as /tmp/011847xi/datadir/test_filters-fopabuf6/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/filters/path2/ fileZ.txt
2024/11/07 01:18:54 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:18:54 NOTICE: (09)  : copy-as /tmp/011847xi/datadir/test_filters-fopabuf6/fileZ.txt /tmp/011847xi/filters/path1/subdir fileZ.txt
2024/11/07 01:18:54 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:18:54 NOTICE: (10)  : test bisync with filters-file. path2-side fileZ.txt will be filtered.
2024/11/07 01:18:54 NOTICE: (11)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.flt
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filters/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.flt
2024/11/07 01:18:54 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:54 INFO  : Path1 checking for diffs
2024/11/07 01:18:54 INFO  : - Path1    File is new               - subdir/fileZ.txt
2024/11/07 01:18:54 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:54 INFO  : Path2 checking for diffs
2024/11/07 01:18:54 INFO  : Applying changes
2024/11/07 01:18:54 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filters/path2/subdir/fileZ.txt
2024/11/07 01:18:54 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:54 INFO  : subdir/fileZ.txt: Copied (new)
2024/11/07 01:18:54 INFO  : Updating listings
2024/11/07 01:18:54 INFO  : Validating listings for Path1 "/tmp/011847xi/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filters/path2/"
2024/11/07 01:18:54 INFO  : Bisync successful
    bisync_test.go:558: TEST filters PASSED
=== RUN   TestBisyncLocalRemote/filtersfile_checks
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/filtersfile_checks/path1"
2024/11/07 01:18:54 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:54 DEBUG : path2: Making directory
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:54 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2"
2024/11/07 01:18:54 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:54 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:54 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:54 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:54 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2"
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_filtersfile_checks-gaboged3"
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:54 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:54 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:54 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/initdir/test_filtersfile_checks-gaboged3: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/initdir/test_filtersfile_checks-gaboged3: Waiting for transfers to finish
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_filtersfile_checks-rimaduq2"
2024/11/07 01:18:54 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/datadir/test_filtersfile_checks-rimaduq2: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/datadir/test_filtersfile_checks-rimaduq2: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK
2024/11/07 01:18:54 DEBUG : filtersfile.txt.f1af69b0.partial: renamed to: filtersfile.txt
2024/11/07 01:18:54 INFO  : filtersfile.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:54 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK
2024/11/07 01:18:54 DEBUG : filtersfile2.txt.9f8671d3.partial: renamed to: filtersfile2.txt
2024/11/07 01:18:54 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:54 INFO  : filtersfile2.txt: Copied (new)
2024/11/07 01:18:54 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:54 ERROR : : error listing: directory not found
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: list [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2]
2024/11/07 01:18:54 ERROR : : error listing: directory not found
2024/11/07 01:18:54 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_filtersfile_checks-gaboged3
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:54 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:54 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/filtersfile_checks/path1: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:54 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:54 DEBUG : Local file system at /tmp/011847xi/filtersfile_checks/path1: Waiting for transfers to finish
2024/11/07 01:18:54 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:54 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 NOTICE: checking Path1 Local file system at /tmp/011847xi/filtersfile_checks/path1
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: list [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2]
2024/11/07 01:18:54 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : subdir: Making directory
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/subdir]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: update [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/RCLONE_TEST]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: update [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/file1.txt]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: update [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/file2.txt]
2024/11/07 01:18:54 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: Waiting for checks to finish
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: update [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/subdir/file20.txt]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: Waiting for transfers to finish
2024/11/07 01:18:54 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:54 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/RCLONE_TEST: replication in progress)
2024/11/07 01:18:54 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2024/11/07 01:18:54 DEBUG : pacer: Reducing sleep to 30ms
2024/11/07 01:18:54 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:54 DEBUG : pacer: Reducing sleep to 22.5ms
2024/11/07 01:18:54 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:54 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: list [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2]
2024/11/07 01:18:54 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2: list [/rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/subdir]
2024/11/07 01:18:54 NOTICE: (01)  : test filtersfile-checks
2024/11/07 01:18:54 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:54 NOTICE: (03)  : bisync resync
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:54 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:54 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:54 INFO  : Resync updating listings
2024/11/07 01:18:54 INFO  : Validating listings for Path1 "/tmp/011847xi/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Bisync successful
2024/11/07 01:18:54 NOTICE: (04)  : test 1. inject filters file in workdir.
2024/11/07 01:18:54 NOTICE: (05)  : copy-file /tmp/011847xi/datadir/test_filtersfile_checks-rimaduq2/filtersfile.txt /tmp/011847xi/workdir/
2024/11/07 01:18:54 INFO  : filtersfile.txt: Copied (new)
2024/11/07 01:18:54 NOTICE: (06)  : test 2. run with filters-file but without md5. should abort.
2024/11/07 01:18:54 NOTICE: (07)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:54 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:54 NOTICE: (08)  : test 3. run without filters-file. should be blocked due to prior abort.
2024/11/07 01:18:54 NOTICE: (09)  : bisync
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011847xi/workdir/tmp_011847xi_filtersfile_checks_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_filtersfile_checks_path2.path1.lst
Path2: /tmp/011847xi/workdir/tmp_011847xi_filtersfile_checks_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_filtersfile_checks_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011847xi/workdir"
2024/11/07 01:18:54 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:54 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:54 NOTICE: (10)  : test 4. run with filters-file and resync.
2024/11/07 01:18:54 NOTICE: (11)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.txt resync
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 INFO  : Storing filters file hash to /tmp/011847xi/workdir/filtersfile.txt.md5
2024/11/07 01:18:54 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:54 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:54 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:54 INFO  : Resync updating listings
2024/11/07 01:18:54 INFO  : Validating listings for Path1 "/tmp/011847xi/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Bisync successful
2024/11/07 01:18:54 NOTICE: (12)  : test 5. run with filters-file alone. should run.
2024/11/07 01:18:54 NOTICE: (13)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:54 INFO  : Path1 checking for diffs
2024/11/07 01:18:54 INFO  : Path2 checking for diffs
2024/11/07 01:18:54 INFO  : No changes found
2024/11/07 01:18:54 INFO  : Updating listings
2024/11/07 01:18:54 INFO  : Validating listings for Path1 "/tmp/011847xi/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Bisync successful
2024/11/07 01:18:54 NOTICE: (14)  : test 6. push changed filters-file to workdir.
2024/11/07 01:18:54 NOTICE: (15)  : copy-as /tmp/011847xi/datadir/test_filtersfile_checks-rimaduq2/filtersfile2.txt /tmp/011847xi/workdir/ filtersfile.txt
2024/11/07 01:18:54 INFO  : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt
2024/11/07 01:18:54 NOTICE: (16)  : test 7. run with filters-file alone. should abort.
2024/11/07 01:18:54 NOTICE: (17)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:54 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:54 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:54 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:54 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:54 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:54 NOTICE: Bisync error: bisync aborted
2024/11/07 01:18:54 NOTICE: (18)  : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort.
2024/11/07 01:18:54 NOTICE: (19)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.txt resync dry-run
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:55 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:55 INFO  : Skipped storing filters file hash to /tmp/011847xi/workdir/filtersfile.txt.md5 as --dry-run is set
2024/11/07 01:18:55 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:55 NOTICE: - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:55 NOTICE: - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:55 INFO  : Resync updating listings
2024/11/07 01:18:55 INFO  : Bisync successful
2024/11/07 01:18:55 NOTICE: (20)  : test 9. run with filters-file alone. should abort.
2024/11/07 01:18:55 NOTICE: (21)  : bisync filters-file=/tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/filtersfile_checks/path2/"
2024/11/07 01:18:55 INFO  : Using filters file /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:55 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/011847xi/workdir/filtersfile.txt
2024/11/07 01:18:55 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:55 NOTICE: Bisync error: bisync aborted
    bisync_test.go:558: TEST filtersfile_checks PASSED
=== RUN   TestBisyncLocalRemote/ignorelistingchecksum
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/ignorelistingchecksum/path1"
2024/11/07 01:18:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:55 DEBUG : path2: Making directory
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2"
2024/11/07 01:18:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2"
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_ignorelistingchecksum-tariwiy1"
2024/11/07 01:18:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:55 INFO  : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:55 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:55 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:55 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:55 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:55 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:55 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:55 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:55 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:55 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:55 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/initdir/test_ignorelistingchecksum-tariwiy1: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/initdir/test_ignorelistingchecksum-tariwiy1: Waiting for transfers to finish
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_ignorelistingchecksum-rihiwub3"
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/datadir/test_ignorelistingchecksum-rihiwub3: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/datadir/test_ignorelistingchecksum-rihiwub3: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:55 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 ERROR : : error listing: directory not found
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: list [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2]
2024/11/07 01:18:55 ERROR : : error listing: directory not found
2024/11/07 01:18:55 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_ignorelistingchecksum-tariwiy1
2024/11/07 01:18:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:55 INFO  : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:55 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:55 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:55 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:55 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:55 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:55 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/ignorelistingchecksum/path1: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/ignorelistingchecksum/path1: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:55 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:55 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:55 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:55 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 NOTICE: checking Path1 Local file system at /tmp/011847xi/ignorelistingchecksum/path1
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: list [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2]
2024/11/07 01:18:55 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : subdir: Making directory
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/RCLONE_TEST]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/subdir]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/file1.copy1.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/file1.copy2.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/file1.copy3.txt]
2024/11/07 01:18:55 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: Waiting for transfers to finish
2024/11/07 01:18:55 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/file1.copy4.txt]
2024/11/07 01:18:55 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/file1.copy5.txt]
2024/11/07 01:18:55 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/file1.txt]
2024/11/07 01:18:55 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: update [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/subdir/file20.txt]
2024/11/07 01:18:55 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:55 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: list [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2: list [/rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/subdir]
2024/11/07 01:18:55 NOTICE: (01)  : test basic
2024/11/07 01:18:55 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:55 NOTICE: (03)  : bisync resync
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/"
2024/11/07 01:18:55 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:55 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:55 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:55 INFO  : Resync updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
2024/11/07 01:18:55 NOTICE: (04)  : bisync resync ignore-listing-checksum
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/"
2024/11/07 01:18:55 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:55 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:55 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:55 INFO  : Resync updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
2024/11/07 01:18:55 NOTICE: (05)  : test place newer files on both paths
2024/11/07 01:18:55 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_ignorelistingchecksum-rihiwub3/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/
2024/11/07 01:18:55 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:55 NOTICE: (07)  : copy-as /tmp/011847xi/datadir/test_ignorelistingchecksum-rihiwub3/file1.txt /tmp/011847xi/ignorelistingchecksum/path1/subdir file20.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (replaced existing) to: file20.txt
2024/11/07 01:18:55 NOTICE: (08)  : test bisync run
2024/11/07 01:18:55 NOTICE: (09)  : bisync ignore-listing-checksum
2024/11/07 01:18:55 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/"
2024/11/07 01:18:55 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:55 INFO  : Path1 checking for diffs
2024/11/07 01:18:55 INFO  : - Path1    File changed: size (larger), time (newer) - subdir/file20.txt
2024/11/07 01:18:55 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:55 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:55 INFO  : Path2 checking for diffs
2024/11/07 01:18:55 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:55 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:55 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:55 INFO  : Applying changes
2024/11/07 01:18:55 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/subdir/file20.txt
2024/11/07 01:18:55 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/ignorelistingchecksum/path1/file1.txt
2024/11/07 01:18:55 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:55 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:55 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:55 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:55 INFO  : Updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/ignorelistingchecksum/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
    bisync_test.go:558: TEST ignorelistingchecksum PASSED
=== RUN   TestBisyncLocalRemote/max_delete_path1
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/max_delete_path1/path1"
2024/11/07 01:18:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:55 DEBUG : path2: Making directory
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2"
2024/11/07 01:18:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2"
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_max_delete_path1-puwayuf4"
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/initdir/test_max_delete_path1-puwayuf4: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:55 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:55 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:55 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:55 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:55 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:55 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:55 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/initdir/test_max_delete_path1-puwayuf4: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:55 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:55 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_max_delete_path1-jilaces8"
2024/11/07 01:18:55 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/datadir/test_max_delete_path1-jilaces8: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/datadir/test_max_delete_path1-jilaces8: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:55 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:55 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:55 ERROR : : error listing: directory not found
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: list [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2]
2024/11/07 01:18:55 ERROR : : error listing: directory not found
2024/11/07 01:18:55 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_max_delete_path1-puwayuf4
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/max_delete_path1/path1: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/max_delete_path1/path1: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:55 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:55 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:55 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:55 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:55 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:55 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:55 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:55 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:55 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:55 NOTICE: checking Path1 Local file system at /tmp/011847xi/max_delete_path1/path1
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: list [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2]
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file1.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file3.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file4.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file2.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: Waiting for transfers to finish
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file5.txt]
2024/11/07 01:18:55 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file6.txt]
2024/11/07 01:18:55 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file7.txt]
2024/11/07 01:18:55 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file8.txt]
2024/11/07 01:18:55 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file9.txt]
2024/11/07 01:18:55 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:55 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2: list [/rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2]
2024/11/07 01:18:55 NOTICE: (01)  : test max-delete-path1
2024/11/07 01:18:55 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:55 NOTICE: (03)  : bisync resync
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/"
2024/11/07 01:18:55 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:55 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:55 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:55 INFO  : Resync updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
2024/11/07 01:18:55 NOTICE: (04)  : test delete >50% of local files
2024/11/07 01:18:55 NOTICE: (05)  : delete-file /tmp/011847xi/max_delete_path1/path1/file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Deleted
2024/11/07 01:18:55 NOTICE: (06)  : delete-file /tmp/011847xi/max_delete_path1/path1/file2.txt
2024/11/07 01:18:55 INFO  : file2.txt: Deleted
2024/11/07 01:18:55 NOTICE: (07)  : delete-file /tmp/011847xi/max_delete_path1/path1/file3.txt
2024/11/07 01:18:55 INFO  : file3.txt: Deleted
2024/11/07 01:18:55 NOTICE: (08)  : delete-file /tmp/011847xi/max_delete_path1/path1/file4.txt
2024/11/07 01:18:55 INFO  : file4.txt: Deleted
2024/11/07 01:18:55 NOTICE: (09)  : delete-file /tmp/011847xi/max_delete_path1/path1/file5.txt
2024/11/07 01:18:55 INFO  : file5.txt: Deleted
2024/11/07 01:18:55 NOTICE: (10)  : test sync should fail due to too many local deletes
2024/11/07 01:18:55 NOTICE: (11)  : bisync
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/"
2024/11/07 01:18:55 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:55 INFO  : Path1 checking for diffs
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file1.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file2.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file3.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file5.txt
2024/11/07 01:18:55 INFO  : Path1:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:55 INFO  : Path2 checking for diffs
2024/11/07 01:18:55 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "/tmp/011847xi/max_delete_path1/path1/". Run with --force if desired.
2024/11/07 01:18:55 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:18:55 NOTICE: Bisync error: too many deletes
2024/11/07 01:18:55 NOTICE: (12)  : copy-listings initial-fail
2024/11/07 01:18:55 NOTICE: (13)  : test change max-delete limit to 60%. sync should run.
2024/11/07 01:18:55 NOTICE: (14)  : bisync max-delete=60
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/"
2024/11/07 01:18:55 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:55 INFO  : Path1 checking for diffs
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file1.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file2.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file3.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:55 INFO  : - Path1    File was deleted          - file5.txt
2024/11/07 01:18:55 INFO  : Path1:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:55 INFO  : Path2 checking for diffs
2024/11/07 01:18:55 INFO  : Applying changes
2024/11/07 01:18:55 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file1.txt
2024/11/07 01:18:55 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file2.txt
2024/11/07 01:18:55 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file3.txt
2024/11/07 01:18:55 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file4.txt
2024/11/07 01:18:55 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/file5.txt
2024/11/07 01:18:55 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:55 INFO  : file3.txt: Deleted
2024/11/07 01:18:55 INFO  : file4.txt: Deleted
2024/11/07 01:18:55 INFO  : file5.txt: Deleted
2024/11/07 01:18:55 INFO  : file1.txt: Deleted
2024/11/07 01:18:55 INFO  : file2.txt: Deleted
2024/11/07 01:18:55 INFO  : Updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path1/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
    bisync_test.go:558: TEST max_delete_path1 PASSED
=== RUN   TestBisyncLocalRemote/max_delete_path2_force
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/max_delete_path2_force/path1"
2024/11/07 01:18:55 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:55 DEBUG : path2: Making directory
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:55 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2"
2024/11/07 01:18:55 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:55 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:55 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:55 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:55 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2"
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_max_delete_path2_force-zoyojuq7"
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:55 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:55 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:55 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:55 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:55 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:55 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/initdir/test_max_delete_path2_force-zoyojuq7: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:55 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/initdir/test_max_delete_path2_force-zoyojuq7: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:55 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:55 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_max_delete_path2_force-fopuboz1"
2024/11/07 01:18:55 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/datadir/test_max_delete_path2_force-fopuboz1: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/datadir/test_max_delete_path2_force-fopuboz1: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:18:55 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:18:55 INFO  : hold.txt: Copied (new)
2024/11/07 01:18:55 ERROR : : error listing: directory not found
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: list [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2]
2024/11/07 01:18:55 ERROR : : error listing: directory not found
2024/11/07 01:18:55 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_max_delete_path2_force-zoyojuq7
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/max_delete_path2_force/path1: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:55 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : Local file system at /tmp/011847xi/max_delete_path2_force/path1: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:55 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:55 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:55 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:55 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:55 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:55 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:55 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:55 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:18:55 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:55 NOTICE: checking Path1 Local file system at /tmp/011847xi/max_delete_path2_force/path1
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: list [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2]
2024/11/07 01:18:55 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file2.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file3.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file4.txt]
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: Waiting for checks to finish
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: Waiting for transfers to finish
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file1.txt]
2024/11/07 01:18:55 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file5.txt]
2024/11/07 01:18:55 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file6.txt]
2024/11/07 01:18:55 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file7.txt]
2024/11/07 01:18:55 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file8.txt]
2024/11/07 01:18:55 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: update [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file9.txt]
2024/11/07 01:18:55 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:55 INFO  : file9.txt: Copied (new)
2024/11/07 01:18:55 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2
2024/11/07 01:18:55 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2: list [/rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2]
2024/11/07 01:18:55 NOTICE: (01)  : test max-delete-path2-force
2024/11/07 01:18:55 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:55 NOTICE: (03)  : bisync resync
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/"
2024/11/07 01:18:55 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:55 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:55 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:55 INFO  : Resync updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
2024/11/07 01:18:55 NOTICE: (04)  : test delete >50% of remote files
2024/11/07 01:18:55 NOTICE: (05)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file1.txt
2024/11/07 01:18:55 INFO  : file1.txt: Deleted
2024/11/07 01:18:55 NOTICE: (06)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file2.txt
2024/11/07 01:18:55 INFO  : file2.txt: Deleted
2024/11/07 01:18:55 NOTICE: (07)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file3.txt
2024/11/07 01:18:55 INFO  : file3.txt: Deleted
2024/11/07 01:18:55 NOTICE: (08)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file4.txt
2024/11/07 01:18:55 INFO  : file4.txt: Deleted
2024/11/07 01:18:55 NOTICE: (09)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/file5.txt
2024/11/07 01:18:55 INFO  : file5.txt: Deleted
2024/11/07 01:18:55 NOTICE: (10)  : test sync should fail due to too many path2 deletes
2024/11/07 01:18:55 NOTICE: (11)  : bisync
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/"
2024/11/07 01:18:55 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:55 INFO  : Path1 checking for diffs
2024/11/07 01:18:55 INFO  : Path2 checking for diffs
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file1.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file2.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file4.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file5.txt
2024/11/07 01:18:55 INFO  : Path2:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:55 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/". Run with --force if desired.
2024/11/07 01:18:55 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:18:55 NOTICE: Bisync error: too many deletes
2024/11/07 01:18:55 NOTICE: (12)  : copy-listings initial-fail
2024/11/07 01:18:55 NOTICE: (13)  : test apply force option. sync should run.
2024/11/07 01:18:55 NOTICE: (14)  : bisync force
2024/11/07 01:18:55 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:55 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:55 INFO  : Synching Path1 "/tmp/011847xi/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/"
2024/11/07 01:18:55 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:55 INFO  : Path1 checking for diffs
2024/11/07 01:18:55 INFO  : Path2 checking for diffs
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file1.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file2.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file4.txt
2024/11/07 01:18:55 INFO  : - Path2    File was deleted          - file5.txt
2024/11/07 01:18:55 INFO  : Path2:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:18:55 INFO  : Applying changes
2024/11/07 01:18:55 INFO  : - Path1    Queue delete              - /tmp/011847xi/max_delete_path2_force/path1/file1.txt
2024/11/07 01:18:55 INFO  : - Path1    Queue delete              - /tmp/011847xi/max_delete_path2_force/path1/file2.txt
2024/11/07 01:18:55 INFO  : - Path1    Queue delete              - /tmp/011847xi/max_delete_path2_force/path1/file3.txt
2024/11/07 01:18:55 INFO  : - Path1    Queue delete              - /tmp/011847xi/max_delete_path2_force/path1/file4.txt
2024/11/07 01:18:55 INFO  : - Path1    Queue delete              - /tmp/011847xi/max_delete_path2_force/path1/file5.txt
2024/11/07 01:18:55 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:55 INFO  : file1.txt: Deleted
2024/11/07 01:18:55 INFO  : file5.txt: Deleted
2024/11/07 01:18:55 INFO  : file2.txt: Deleted
2024/11/07 01:18:55 INFO  : file3.txt: Deleted
2024/11/07 01:18:55 INFO  : file4.txt: Deleted
2024/11/07 01:18:55 INFO  : Updating listings
2024/11/07 01:18:55 INFO  : Validating listings for Path1 "/tmp/011847xi/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/max_delete_path2_force/path2/"
2024/11/07 01:18:55 INFO  : Bisync successful
    bisync_test.go:558: TEST max_delete_path2_force PASSED
=== RUN   TestBisyncLocalRemote/nomodtime
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/nomodtime/path1"
2024/11/07 01:18:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:56 DEBUG : path2: Making directory
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2"
2024/11/07 01:18:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2"
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_nomodtime-mufeloc3"
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:56 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/initdir/test_nomodtime-mufeloc3: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/initdir/test_nomodtime-mufeloc3: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:56 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:56 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:56 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:56 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:56 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:56 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_nomodtime-viwituf7"
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/datadir/test_nomodtime-viwituf7: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/datadir/test_nomodtime-viwituf7: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt
2024/11/07 01:18:56 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:56 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt
2024/11/07 01:18:56 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:56 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:56 DEBUG : file5R.txt.9ed658ed.partial: renamed to: file5R.txt
2024/11/07 01:18:56 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt
2024/11/07 01:18:56 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file5L.txt.9ed658ed.partial: renamed to: file5L.txt
2024/11/07 01:18:56 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt
2024/11/07 01:18:56 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:56 ERROR : : error listing: directory not found
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: list [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2]
2024/11/07 01:18:56 ERROR : : error listing: directory not found
2024/11/07 01:18:56 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_nomodtime-mufeloc3
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/nomodtime/path1: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/nomodtime/path1: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:56 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:56 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:56 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:56 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:56 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:56 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:56 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:56 NOTICE: checking Path1 Local file system at /tmp/011847xi/nomodtime/path1
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: list [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2]
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/RCLONE_TEST]
2024/11/07 01:18:56 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file1.txt]
2024/11/07 01:18:56 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file2.txt]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file3.txt]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: Waiting for transfers to finish
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file4.txt]
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file5.txt]
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file6.txt]
2024/11/07 01:18:56 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file7.txt]
2024/11/07 01:18:56 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: update [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file8.txt]
2024/11/07 01:18:56 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:56 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2: list [/rclone-test-zedewoz4gosi/011847xi/nomodtime/path2]
2024/11/07 01:18:56 NOTICE: (01)  : test changes
2024/11/07 01:18:56 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:56 NOTICE: (03)  : bisync resync nomodtime
2024/11/07 01:18:56 NOTICE: Local file system at /tmp/011847xi/nomodtime/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:56 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:56 INFO  : Synching Path1 "/tmp/011847xi/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/"
2024/11/07 01:18:56 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:56 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:56 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:56 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:56 INFO  : Resync updating listings
2024/11/07 01:18:56 INFO  : Validating listings for Path1 "/tmp/011847xi/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/"
2024/11/07 01:18:56 INFO  : Bisync successful
2024/11/07 01:18:56 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:18:56 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:18:56 NOTICE: (06)  : copy-file /tmp/011847xi/datadir/test_nomodtime-viwituf7/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/
2024/11/07 01:18:56 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:56 NOTICE: (07)  : test changed on path2 - file1
2024/11/07 01:18:56 NOTICE: (08)  : copy-file /tmp/011847xi/datadir/test_nomodtime-viwituf7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/
2024/11/07 01:18:56 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:18:56 NOTICE: (10)  : copy-file /tmp/011847xi/datadir/test_nomodtime-viwituf7/file11.txt /tmp/011847xi/nomodtime/path1/
2024/11/07 01:18:56 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:56 NOTICE: (11)  : test changed on path1 - file2
2024/11/07 01:18:56 NOTICE: (12)  : copy-file /tmp/011847xi/datadir/test_nomodtime-viwituf7/file2.txt /tmp/011847xi/nomodtime/path1/
2024/11/07 01:18:56 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:18:56 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file3.txt
2024/11/07 01:18:56 INFO  : file3.txt: Deleted
2024/11/07 01:18:56 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:18:56 NOTICE: (16)  : delete-file /tmp/011847xi/nomodtime/path1/file4.txt
2024/11/07 01:18:56 INFO  : file4.txt: Deleted
2024/11/07 01:18:56 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:18:56 NOTICE: (18)  : delete-file /tmp/011847xi/nomodtime/path1/file8.txt
2024/11/07 01:18:56 INFO  : file8.txt: Deleted
2024/11/07 01:18:56 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file8.txt
2024/11/07 01:18:56 INFO  : file8.txt: Deleted
2024/11/07 01:18:56 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:18:56 NOTICE: (21)  : copy-as /tmp/011847xi/datadir/test_nomodtime-viwituf7/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/ file5.txt
2024/11/07 01:18:56 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:56 NOTICE: (22)  : copy-as /tmp/011847xi/datadir/test_nomodtime-viwituf7/file5L.txt /tmp/011847xi/nomodtime/path1/ file5.txt
2024/11/07 01:18:56 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:56 NOTICE: (23)  : test changed on path2 and deleted on path1 - file6
2024/11/07 01:18:56 NOTICE: (24)  : copy-file /tmp/011847xi/datadir/test_nomodtime-viwituf7/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/
2024/11/07 01:18:56 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (25)  : delete-file /tmp/011847xi/nomodtime/path1/file6.txt
2024/11/07 01:18:56 INFO  : file6.txt: Deleted
2024/11/07 01:18:56 NOTICE: (26)  : test changed on path1 and deleted on path2 - file7
2024/11/07 01:18:56 NOTICE: (27)  : copy-file /tmp/011847xi/datadir/test_nomodtime-viwituf7/file7.txt /tmp/011847xi/nomodtime/path1/
2024/11/07 01:18:56 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (28)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file7.txt
2024/11/07 01:18:56 INFO  : file7.txt: Deleted
2024/11/07 01:18:56 NOTICE: (29)  : test bisync run
2024/11/07 01:18:56 NOTICE: (30)  : bisync nomodtime
2024/11/07 01:18:56 NOTICE: Local file system at /tmp/011847xi/nomodtime/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:56 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:56 INFO  : Synching Path1 "/tmp/011847xi/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/"
2024/11/07 01:18:56 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:56 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:56 INFO  : Path1 checking for diffs
2024/11/07 01:18:56 INFO  : - Path1    File changed: size (larger), hash - file2.txt
2024/11/07 01:18:56 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:18:56 INFO  : - Path1    File changed: size (larger), hash - file5.txt
2024/11/07 01:18:56 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:18:56 INFO  : - Path1    File changed: size (larger), hash - file7.txt
2024/11/07 01:18:56 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:18:56 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:18:56 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:56 INFO  : (Modified:    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:56 INFO  : Path2 checking for diffs
2024/11/07 01:18:56 INFO  : - Path2    File changed: size (larger), hash - file1.txt
2024/11/07 01:18:56 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:18:56 INFO  : - Path2    File changed: size (larger), hash - file5.txt
2024/11/07 01:18:56 INFO  : - Path2    File changed: size (larger), hash - file6.txt
2024/11/07 01:18:56 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:18:56 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:18:56 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:18:56 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:18:56 INFO  : (Modified:    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:18:56 INFO  : Applying changes
2024/11/07 01:18:56 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file11.txt
2024/11/07 01:18:56 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file2.txt
2024/11/07 01:18:56 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file4.txt
2024/11/07 01:18:56 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:18:56 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/nomodtime/path1/file5.txt.conflict1
2024/11/07 01:18:56 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:18:56 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file5.txt.conflict1
2024/11/07 01:18:56 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file5.txt.conflict2
2024/11/07 01:18:56 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:18:56 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/nomodtime/path1/file5.txt.conflict2
2024/11/07 01:18:56 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/nomodtime/path1/file6.txt
2024/11/07 01:18:56 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/file7.txt
2024/11/07 01:18:56 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/nomodtime/path1/file1.txt
2024/11/07 01:18:56 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/nomodtime/path1/file10.txt
2024/11/07 01:18:56 INFO  : - Path1    Queue delete              - /tmp/011847xi/nomodtime/path1/file3.txt
2024/11/07 01:18:56 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:56 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:18:56 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:56 INFO  : file3.txt: Deleted
2024/11/07 01:18:56 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:56 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:18:56 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:56 INFO  : file4.txt: Deleted
2024/11/07 01:18:56 INFO  : Updating listings
2024/11/07 01:18:56 INFO  : Validating listings for Path1 "/tmp/011847xi/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/nomodtime/path2/"
2024/11/07 01:18:56 INFO  : Bisync successful
    bisync_test.go:558: TEST nomodtime PASSED
=== RUN   TestBisyncLocalRemote/normalization
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/normalization/path1"
2024/11/07 01:18:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:56 DEBUG : path2: Making directory
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/normalization/path2"
2024/11/07 01:18:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/normalization/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/normalization/path2"
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_normalization-sidejey5"
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory with metadata
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:56 DEBUG : Added delayed dir = "測試_Ру��кий_ _ _ě_áñ", newDst=測試_Ру��кий_ _ _ě_áñ
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/initdir/test_normalization-sidejey5: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/initdir/test_normalization-sidejey5: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file.5028a97.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/測試_check file
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:18:56 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_normalization-damubid5"
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/datadir/test_normalization-damubid5: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/datadir/test_normalization-damubid5: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:18:56 DEBUG : 測試_filtersfile.txt.e8d47346.partial: renamed to: 測試_filtersfile.txt
2024/11/07 01:18:56 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:18:56 ERROR : : error listing: directory not found
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: list [/rclone-test-zedewoz4gosi/011847xi/normalization/path2]
2024/11/07 01:18:56 ERROR : : error listing: directory not found
2024/11/07 01:18:56 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_normalization-sidejey5
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory with metadata
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:18:56 DEBUG : Added delayed dir = "測試_Ру��кий_ _ _ě_áñ", newDst=測試_Ру��кий_ _ _ě_áñ
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/normalization/path1: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/normalization/path1: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:56 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file.5028a97.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/測試_check file
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:18:56 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ: Set directory modification time (using SetModTime)
2024/11/07 01:18:56 NOTICE: checking Path1 Local file system at /tmp/011847xi/normalization/path1
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: list [/rclone-test-zedewoz4gosi/011847xi/normalization/path2]
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: update [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/RCLONE_TEST]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: update [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/file1.txt]
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: update [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: update [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt]
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: update [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/測試_Ру��кий_ _ _ě_áñ/測試_check file]
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-zedewoz4gosi/011847xi/normalization/path2/測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: replication in progress)
2024/11/07 01:18:56 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2024/11/07 01:18:56 DEBUG : pacer: Reducing sleep to 30ms
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : pacer: Reducing sleep to 22.5ms
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:18:56 DEBUG : pacer: Reducing sleep to 20ms
2024/11/07 01:18:56 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:18:56 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: list [/rclone-test-zedewoz4gosi/011847xi/normalization/path2]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2: list [/rclone-test-zedewoz4gosi/011847xi/normalization/path2/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:18:56 NOTICE: (01)  : test normalization
2024/11/07 01:18:56 NOTICE: (02)  : touch-copy 2001-01-02 /tmp/011847xi/datadir/test_normalization-damubid5/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/normalization/path2/
2024/11/07 01:18:56 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (03)  : test initial bisync
2024/11/07 01:18:56 NOTICE: (04)  : bisync resync
2024/11/07 01:18:56 NOTICE: Local file system at /tmp/011847xi/normalization/path1: Replacing invalid UTF-8 characters in "ě\x81\xfe a�ñhࢺ_測試Ру�кийěa�ñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬e�ö"
2024/11/07 01:18:56 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:56 NOTICE: Local file system at /tmp/011847xi/normalization/path1: Replacing invalid UTF-8 characters in "ě\x81\xfe áñhࢺ_測試Ру�кийěáñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö"
2024/11/07 01:18:56 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:18:56 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:18:56 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
    bisync_test.go:1024: Fs is incapable of running test as the paths produce different results, skipping: normalization (path1: 
        測試_Ру��кий_ _ _ě_áñ測試_Ру��кий_ _ _ě_áñ (NFC) path2: 
        測試_РуÑ�Ñ�кий_ _ _Ä›_áñě�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö (測試_РуÑ�Ñ�кий_ _ _Ä›_áñě�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö))
         (fs1: Local file system at /tmp/011847xi/normalization/path1 fs2: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/normalization/path2) 
        @@ -1 +1 @@
        -測試_РуÑ�Ñ�кий_ _ _Ä›_áñ測試_РуÑ�Ñ�кий_ _ _Ä›_áñ+測試_РуÑ�Ñ�кий_ _ _Ä›_áñě�þ áñhࢺ_測試РуÑ�кийěáñ👸ðŸ�¼ðŸ§�ðŸ�¾â€�♀ï¸�💆ðŸ�¿â€�♂ï¸�ðŸ�¨ðŸ¤™ðŸ�¼ðŸ¤®ðŸ§‘ðŸ�»â€�🔧🧑â€�🔬éö
=== RUN   TestBisyncLocalRemote/rclone_args
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/rclone_args/path1"
2024/11/07 01:18:56 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:56 DEBUG : path2: Making directory
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:56 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2"
2024/11/07 01:18:56 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:56 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:56 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:56 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:56 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2"
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_rclone_args-volayes2"
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:56 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:56 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/initdir/test_rclone_args-volayes2: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/initdir/test_rclone_args-volayes2: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:56 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK
2024/11/07 01:18:56 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt
2024/11/07 01:18:56 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:56 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:56 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_rclone_args-daqidun4"
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file20.txt.b4075ff1.partial: renamed to: file20.txt
2024/11/07 01:18:56 INFO  : file20.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/datadir/test_rclone_args-daqidun4: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/datadir/test_rclone_args-daqidun4: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file1.txt.6bedbe24.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file21.txt.b4075ff1.partial: renamed to: file21.txt
2024/11/07 01:18:56 INFO  : file21.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:56 DEBUG : file2.txt.6bedbe24.partial: renamed to: file2.txt
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 ERROR : : error listing: directory not found
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: list [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2]
2024/11/07 01:18:56 ERROR : : error listing: directory not found
2024/11/07 01:18:56 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_rclone_args-volayes2
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:56 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:56 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/rclone_args/path1: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : Local file system at /tmp/011847xi/rclone_args/path1: Waiting for transfers to finish
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:56 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK
2024/11/07 01:18:56 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:56 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:56 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:56 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt
2024/11/07 01:18:56 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:18:56 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:56 NOTICE: checking Path1 Local file system at /tmp/011847xi/rclone_args/path1
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: list [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2]
2024/11/07 01:18:56 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : subdir: Making directory
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: update [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/RCLONE_TEST]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: update [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/file1.txt]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: update [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/file2.txt]
2024/11/07 01:18:56 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: update [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/file20.txt]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: Waiting for checks to finish
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: Waiting for transfers to finish
2024/11/07 01:18:56 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: update [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/file21.txt]
2024/11/07 01:18:56 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:56 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:56 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:56 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:18:56 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: list [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2]
2024/11/07 01:18:56 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2: list [/rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir]
2024/11/07 01:18:56 NOTICE: (01)  : test rclone-args
2024/11/07 01:18:56 NOTICE: (02)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_rclone_args-daqidun4/ *
2024/11/07 01:18:56 NOTICE: (03)  : test initial bisync
2024/11/07 01:18:56 NOTICE: (04)  : bisync resync checksum
2024/11/07 01:18:56 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:56 NOTICE: Local file system at /tmp/011847xi/rclone_args/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:56 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:56 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:56 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:56 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:56 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:56 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:56 INFO  : Resync updating listings
2024/11/07 01:18:56 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:56 INFO  : Bisync successful
2024/11/07 01:18:56 NOTICE: (05)  : test place newer files on both paths
2024/11/07 01:18:56 NOTICE: (06)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file1.txt /tmp/011847xi/rclone_args/path1/
2024/11/07 01:18:56 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (07)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/
2024/11/07 01:18:56 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (08)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file20.txt /tmp/011847xi/rclone_args/path1/subdir
2024/11/07 01:18:56 INFO  : file20.txt: Updated modification time in destination
2024/11/07 01:18:56 NOTICE: (09)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir
2024/11/07 01:18:56 INFO  : file21.txt: Copied (replaced existing)
2024/11/07 01:18:56 NOTICE: (10)  : touch-glob 2001-01-02 /tmp/011847xi/rclone_args/path1/ file1.txt
2024/11/07 01:18:56 NOTICE: (11)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/ file2.txt
2024/11/07 01:18:56 NOTICE: (12)  : touch-glob 2001-01-02 /tmp/011847xi/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:56 NOTICE: (13)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:56 NOTICE: (14)  : test run bisync with custom options
2024/11/07 01:18:56 NOTICE: (15)  : bisync checksum
2024/11/07 01:18:56 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:56 NOTICE: Local file system at /tmp/011847xi/rclone_args/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:56 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:56 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:56 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:56 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:56 INFO  : Path1 checking for diffs
2024/11/07 01:18:56 INFO  : - Path1    File changed: hash - file1.txt
2024/11/07 01:18:56 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:56 INFO  : (Modified:    1 hash differs)
2024/11/07 01:18:56 INFO  : Path2 checking for diffs
2024/11/07 01:18:56 INFO  : - Path2    File changed: size (larger), hash - file2.txt
2024/11/07 01:18:56 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:56 INFO  : (Modified:    1 larger,    0 smaller,    1 hash differs)
2024/11/07 01:18:56 INFO  : Applying changes
2024/11/07 01:18:56 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/file1.txt
2024/11/07 01:18:56 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/rclone_args/path1/file2.txt
2024/11/07 01:18:56 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:56 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:56 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (16)  : touch-glob 2007-07-23 /tmp/011847xi/datadir/test_rclone_args-daqidun4/ *
2024/11/07 01:18:57 NOTICE: (17)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file1.txt /tmp/011847xi/rclone_args/path1/
2024/11/07 01:18:57 INFO  : file1.txt: Updated modification time in destination
2024/11/07 01:18:57 NOTICE: (18)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/
2024/11/07 01:18:57 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:57 NOTICE: (19)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file20.txt /tmp/011847xi/rclone_args/path1/subdir
2024/11/07 01:18:57 INFO  : file20.txt: Updated modification time in destination
2024/11/07 01:18:57 NOTICE: (20)  : copy-as /tmp/011847xi/datadir/test_rclone_args-daqidun4/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file21.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:57 NOTICE: (21)  : touch-glob 2007-07-23 /tmp/011847xi/rclone_args/path1/ file1.txt
2024/11/07 01:18:57 NOTICE: (22)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/ file2.txt
2024/11/07 01:18:57 NOTICE: (23)  : touch-glob 2007-07-23 /tmp/011847xi/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:57 NOTICE: (24)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:57 NOTICE: (25)  : bisync size-only
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File changed: size (smaller) - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    0 larger,    1 smaller)
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/rclone_args/path1/file1.txt
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (26)  : bisync resync
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:57 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:57 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:57 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : Resync updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (27)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file1.txt /tmp/011847xi/rclone_args/path1/
2024/11/07 01:18:57 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:57 NOTICE: (28)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/
2024/11/07 01:18:57 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:57 NOTICE: (29)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file20.txt /tmp/011847xi/rclone_args/path1/subdir
2024/11/07 01:18:57 NOTICE: (30)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir
2024/11/07 01:18:57 INFO  : file21.txt: Copied (replaced existing)
2024/11/07 01:18:57 NOTICE: (31)  : touch-glob 2007-07-23 /tmp/011847xi/rclone_args/path1/ file1.txt
2024/11/07 01:18:57 NOTICE: (32)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/ file2.txt
2024/11/07 01:18:57 NOTICE: (33)  : touch-glob 2007-07-23 /tmp/011847xi/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:57 NOTICE: (34)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:57 NOTICE: (35)  : bisync ignore-size
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": false,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File changed: time (newer) - file2.txt
2024/11/07 01:18:57 INFO  : - Path2    File changed: time (newer) - subdir/file21.txt
2024/11/07 01:18:57 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    2 newer,    0 older)
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/rclone_args/path1/file2.txt
2024/11/07 01:18:57 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/rclone_args/path1/subdir/file21.txt
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (36)  : bisync resync compare-all
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 NOTICE: Local file system at /tmp/011847xi/rclone_args/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:57 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:57 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:57 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:57 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : Resync updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (37)  : copy-as /tmp/011847xi/datadir/test_rclone_args-daqidun4/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/ file2.txt
2024/11/07 01:18:57 INFO  : file21.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:57 NOTICE: (38)  : touch-glob 2023-08-26 /tmp/011847xi/datadir/test_rclone_args-daqidun4/ *
2024/11/07 01:18:57 NOTICE: (39)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file1.txt /tmp/011847xi/rclone_args/path1/
2024/11/07 01:18:57 INFO  : file1.txt: Updated modification time in destination
2024/11/07 01:18:57 NOTICE: (40)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file20.txt /tmp/011847xi/rclone_args/path1/subdir
2024/11/07 01:18:57 INFO  : file20.txt: Updated modification time in destination
2024/11/07 01:18:57 NOTICE: (41)  : copy-file /tmp/011847xi/datadir/test_rclone_args-daqidun4/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir
2024/11/07 01:18:57 INFO  : file21.txt: Copied (replaced existing)
2024/11/07 01:18:57 NOTICE: (42)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/ file2.txt
2024/11/07 01:18:57 NOTICE: (43)  : touch-glob 2023-08-26 /tmp/011847xi/rclone_args/path1/ file1.txt
2024/11/07 01:18:57 NOTICE: (44)  : touch-glob 2023-08-26 /tmp/011847xi/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:18:57 NOTICE: (45)  : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:18:57 NOTICE: (46)  : bisync compare-all
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 NOTICE: Local file system at /tmp/011847xi/rclone_args/path1: will use md5 for same-side diffs on Path1 only
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 1,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": true
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:18:57 INFO  : - Path1    File changed: time (newer) - subdir/file20.txt
2024/11/07 01:18:57 INFO  : Path1:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    2 newer,    0 older)
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File changed: size (smaller), hash - file2.txt
2024/11/07 01:18:57 INFO  : - Path2    File changed: time (newer) - subdir/file21.txt
2024/11/07 01:18:57 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older,    0 larger,    1 smaller,    1 hash differs)
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/file1.txt
2024/11/07 01:18:57 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/subdir/file20.txt
2024/11/07 01:18:57 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/rclone_args/path1/file2.txt
2024/11/07 01:18:57 INFO  : - Path2    Queue copy to Path1       - /tmp/011847xi/rclone_args/path1/subdir/file21.txt
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rclone_args/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
    bisync_test.go:558: TEST rclone_args PASSED
=== RUN   TestBisyncLocalRemote/resolve
2024/11/07 01:18:57 DEBUG : Creating backend with remote "/tmp/011847xi/resolve/path1"
2024/11/07 01:18:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:57 DEBUG : path2: Making directory
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/resolve/path2"
2024/11/07 01:18:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/resolve/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2"
2024/11/07 01:18:57 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_resolve-hupibiq4"
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/initdir/test_resolve-hupibiq4: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/initdir/test_resolve-hupibiq4: Waiting for transfers to finish
2024/11/07 01:18:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:57 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:57 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:57 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_resolve-letucoh9"
2024/11/07 01:18:57 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/datadir/test_resolve-letucoh9: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/datadir/test_resolve-letucoh9: Waiting for transfers to finish
2024/11/07 01:18:57 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK
2024/11/07 01:18:57 DEBUG : file1R.txt.eafd8cfe.partial: renamed to: file1R.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:18:57 DEBUG : file1L.txt.711f2f3a.partial: renamed to: file1L.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:18:57 DEBUG : file2.txt.cc713425.partial: renamed to: file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 ERROR : : error listing: directory not found
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: list [/rclone-test-zedewoz4gosi/011847xi/resolve/path2]
2024/11/07 01:18:57 ERROR : : error listing: directory not found
2024/11/07 01:18:57 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_resolve-hupibiq4
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:57 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:57 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:57 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/resolve/path1: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/resolve/path1: Waiting for transfers to finish
2024/11/07 01:18:57 NOTICE: checking Path1 Local file system at /tmp/011847xi/resolve/path1
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: list [/rclone-test-zedewoz4gosi/011847xi/resolve/path2]
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: update [/rclone-test-zedewoz4gosi/011847xi/resolve/path2/RCLONE_TEST]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: update [/rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: update [/rclone-test-zedewoz4gosi/011847xi/resolve/path2/file2.txt]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: Waiting for transfers to finish
2024/11/07 01:18:57 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: list [/rclone-test-zedewoz4gosi/011847xi/resolve/path2]
2024/11/07 01:18:57 NOTICE: (01)  : test resolve
2024/11/07 01:18:57 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:57 NOTICE: (03)  : bisync resync
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:57 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:57 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:57 INFO  : Resync updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (04)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:57 NOTICE: (05)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1R.txt
2024/11/07 01:18:57 NOTICE: (06)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:57 NOTICE: (07)  : touch-glob 2001-03-04 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1L.txt
2024/11/07 01:18:57 NOTICE: (08)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt /tmp/011847xi/resolve/path1/ file1.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:57 NOTICE: (09)  : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato
2024/11/07 01:18:57 NOTICE: (10)  : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:57 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Checking potential conflicts...
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 differences found
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 errors while checking
2024/11/07 01:18:57 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s
2024/11/07 01:18:57 INFO  : file1.txt: The winner is: Path1
2024/11/07 01:18:57 NOTICE: - Path2    Deleting Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Deleted
2024/11/07 01:18:57 INFO  : - Path1    Queue copy to Path2       - file1.txt
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (11)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:57 NOTICE: (12)  : touch-glob 2001-07-23 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1R.txt
2024/11/07 01:18:57 NOTICE: (13)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:57 NOTICE: (14)  : touch-glob 2001-08-26 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1L.txt
2024/11/07 01:18:57 NOTICE: (15)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt /tmp/011847xi/resolve/path1/ file1.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Updated modification time in destination
2024/11/07 01:18:57 NOTICE: (16)  : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur
2024/11/07 01:18:57 NOTICE: (17)  : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:18:57 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File changed: time (newer) - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Checking potential conflicts...
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 differences found
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 errors while checking
2024/11/07 01:18:57 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: The winner is: Path2
2024/11/07 01:18:57 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/resolve/path1/file1.txt.dinosaur1
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt.dinosaur1
2024/11/07 01:18:57 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt.dinosaur1
2024/11/07 01:18:57 NOTICE: - Path2    Not renaming Path2 copy, as it was determined the winner - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt
2024/11/07 01:18:57 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/resolve/path1/file1.txt
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt.dinosaur1: Copied (new)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (18)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:57 NOTICE: (19)  : touch-glob 2002-07-23 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1R.txt
2024/11/07 01:18:57 NOTICE: (20)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:57 NOTICE: (21)  : touch-glob 2002-08-26 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1L.txt
2024/11/07 01:18:57 NOTICE: (22)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt /tmp/011847xi/resolve/path1/ file1.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:57 NOTICE: (23)  : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple
2024/11/07 01:18:57 NOTICE: (24)  : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Checking potential conflicts...
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 differences found
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 errors while checking
2024/11/07 01:18:57 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0
2024/11/07 01:18:57 INFO  : file1.txt: A winner could not be determined.
2024/11/07 01:18:57 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/resolve/path1/file1.txt.apple1
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt.apple1
2024/11/07 01:18:57 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt.apple1
2024/11/07 01:18:57 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt.apple2
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt.apple2
2024/11/07 01:18:57 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/resolve/path1/file1.txt.apple2
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file1.txt.apple2: Copied (new)
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt.apple1: Copied (new)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (25)  : test different suffixes
2024/11/07 01:18:57 NOTICE: (26)  : touch-glob 2003-07-23 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1R.txt
2024/11/07 01:18:57 NOTICE: (27)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:18:57 NOTICE: (28)  : touch-glob 2003-07-23 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1L.txt
2024/11/07 01:18:57 NOTICE: (29)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt /tmp/011847xi/resolve/path1/ file1.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:18:57 NOTICE: (30)  : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local
2024/11/07 01:18:57 NOTICE: (31)  : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Checking potential conflicts...
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 differences found
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 errors while checking
2024/11/07 01:18:57 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s
2024/11/07 01:18:57 INFO  : file1.txt: A winner could not be determined.
2024/11/07 01:18:57 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/resolve/path1/file1.txt.cloud1
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt.cloud1
2024/11/07 01:18:57 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt.cloud1
2024/11/07 01:18:57 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt.local1
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt.local1
2024/11/07 01:18:57 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/resolve/path1/file1.txt.local1
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file1.txt.local1: Copied (new)
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt.cloud1: Copied (new)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (32)  : test legacy
2024/11/07 01:18:57 NOTICE: (33)  : touch-glob 2004-07-23 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1R.txt
2024/11/07 01:18:57 NOTICE: (34)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:18:57 NOTICE: (35)  : touch-glob 2004-07-23 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1L.txt
2024/11/07 01:18:57 NOTICE: (36)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt /tmp/011847xi/resolve/path1/ file1.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:18:57 NOTICE: (37)  : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path
2024/11/07 01:18:57 NOTICE: (38)  : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Checking potential conflicts...
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 differences found
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 1 errors while checking
2024/11/07 01:18:57 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:57 NOTICE: - Path1    Renaming Path1 copy                - /tmp/011847xi/resolve/path1/file1.txt..path1
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt..path1
2024/11/07 01:18:57 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt..path1
2024/11/07 01:18:57 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt..path2
2024/11/07 01:18:57 INFO  : file1.txt: Moved (server-side) to: file1.txt..path2
2024/11/07 01:18:57 NOTICE: - Path2    Queue copy to Path1       - /tmp/011847xi/resolve/path1/file1.txt..path2
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file1.txt..path2: Copied (new)
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt..path1: Copied (new)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
2024/11/07 01:18:57 NOTICE: (39)  : test deletes on both sides with default suffix
2024/11/07 01:18:57 NOTICE: (40)  : touch-glob 2005-01-02 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1R.txt
2024/11/07 01:18:57 NOTICE: (41)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file1.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:18:57 NOTICE: (42)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1R.txt /tmp/011847xi/resolve/path1/ file2.txt
2024/11/07 01:18:57 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:57 NOTICE: (43)  : touch-glob 2006-03-04 /tmp/011847xi/datadir/test_resolve-letucoh9/ file1L.txt
2024/11/07 01:18:57 NOTICE: (44)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt /tmp/011847xi/resolve/path1/ file1.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:18:57 NOTICE: (45)  : copy-as /tmp/011847xi/datadir/test_resolve-letucoh9/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resolve/path2/ file2.txt
2024/11/07 01:18:57 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:57 NOTICE: (46)  : test bisync run with --conflict-resolve=newer --conflict-loser=delete
2024/11/07 01:18:57 NOTICE: (47)  : bisync conflict-resolve=newer conflict-loser=delete
2024/11/07 01:18:57 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:57 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:57 INFO  : Synching Path1 "/tmp/011847xi/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:57 INFO  : Path1 checking for diffs
2024/11/07 01:18:57 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:57 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path1:    2 changes:    1 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:57 INFO  : Path2 checking for diffs
2024/11/07 01:18:57 INFO  : - Path2    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:18:57 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:18:57 INFO  : Path2:    2 changes:    1 new,    1 modified,    0 deleted
2024/11/07 01:18:57 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:18:57 INFO  : Applying changes
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Checking potential conflicts...
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 2 differences found
2024/11/07 01:18:57 NOTICE: hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resolve/path2: 2 errors while checking
2024/11/07 01:18:57 INFO  : Finished checking the potential conflicts. 2 differences found
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s
2024/11/07 01:18:57 INFO  : file1.txt: The winner is: Path1
2024/11/07 01:18:57 NOTICE: - Path2    Deleting Path2 copy                - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Deleted
2024/11/07 01:18:57 INFO  : - Path1    Queue copy to Path2       - file1.txt
2024/11/07 01:18:57 NOTICE: - WARNING  New or changed in both paths       - file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s
2024/11/07 01:18:57 INFO  : file2.txt: The winner is: Path2
2024/11/07 01:18:57 NOTICE: - Path1    Deleting Path1 copy                - /tmp/011847xi/resolve/path1/file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Deleted
2024/11/07 01:18:57 INFO  : - Path2    Queue copy to Path1       - file2.txt
2024/11/07 01:18:57 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 INFO  : Updating listings
2024/11/07 01:18:57 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:18:57 INFO  : Validating listings for Path1 "/tmp/011847xi/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resolve/path2/"
2024/11/07 01:18:57 INFO  : Bisync successful
    bisync_test.go:558: TEST resolve PASSED
=== RUN   TestBisyncLocalRemote/resync
2024/11/07 01:18:57 DEBUG : Creating backend with remote "/tmp/011847xi/resync/path1"
2024/11/07 01:18:57 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:57 DEBUG : path2: Making directory
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:57 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/resync/path2"
2024/11/07 01:18:57 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:57 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:57 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:57 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:57 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/resync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2"
2024/11/07 01:18:57 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_resync-wudapar2"
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/initdir/test_resync-wudapar2: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/initdir/test_resync-wudapar2: Waiting for transfers to finish
2024/11/07 01:18:57 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:57 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:57 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:57 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:57 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:57 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:57 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_resync-yifuwit9"
2024/11/07 01:18:57 DEBUG : fileA.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : fileB.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/datadir/test_resync-yifuwit9: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/datadir/test_resync-yifuwit9: Waiting for transfers to finish
2024/11/07 01:18:57 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:57 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:57 DEBUG : fileB.txt.f0a2c6af.partial: renamed to: fileB.txt
2024/11/07 01:18:57 INFO  : fileB.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : fileA.txt.16ee54da.partial: renamed to: fileA.txt
2024/11/07 01:18:57 INFO  : fileA.txt: Copied (new)
2024/11/07 01:18:57 ERROR : : error listing: directory not found
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: list [/rclone-test-zedewoz4gosi/011847xi/resync/path2]
2024/11/07 01:18:57 ERROR : : error listing: directory not found
2024/11/07 01:18:57 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_resync-wudapar2
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/resync/path1: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:57 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:57 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:57 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:57 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:57 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:57 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:57 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : Local file system at /tmp/011847xi/resync/path1: Waiting for transfers to finish
2024/11/07 01:18:57 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:57 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:57 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:57 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:57 NOTICE: checking Path1 Local file system at /tmp/011847xi/resync/path1
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: list [/rclone-test-zedewoz4gosi/011847xi/resync/path2]
2024/11/07 01:18:57 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/RCLONE_TEST]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file1.txt]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file2.txt]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: Waiting for checks to finish
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file3.txt]
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: Waiting for transfers to finish
2024/11/07 01:18:57 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file4.txt]
2024/11/07 01:18:57 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:57 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file5.txt]
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file6.txt]
2024/11/07 01:18:58 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync/path2/file7.txt]
2024/11/07 01:18:58 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:58 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync/path2: list [/rclone-test-zedewoz4gosi/011847xi/resync/path2]
2024/11/07 01:18:58 NOTICE: (01)  : test resync
2024/11/07 01:18:58 NOTICE: (02)  : test 1. resync with empty path1, resulting in copying all content from path2.
2024/11/07 01:18:58 NOTICE: (03)  : purge-children /tmp/011847xi/resync/path1/
2024/11/07 01:18:58 NOTICE: (04)  : bisync resync
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:58 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:58 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (05)  : move-listings empty-path1
2024/11/07 01:18:58 NOTICE: (06)  : test 2. resync with empty path2, resulting in synching all content to path2.
2024/11/07 01:18:58 NOTICE: (07)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/
2024/11/07 01:18:58 NOTICE: (08)  : bisync resync
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:58 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (09)  : move-listings empty-path2
2024/11/07 01:18:58 NOTICE: (10)  : test 3. exercise all of the various file difference scenarios during a resync.
2024/11/07 01:18:58 NOTICE: (11)  : touch-glob 2002-02-02 /tmp/011847xi/datadir/test_resync-yifuwit9/ fileA.txt
2024/11/07 01:18:58 NOTICE: (12)  : touch-glob 1999-09-09 /tmp/011847xi/datadir/test_resync-yifuwit9/ fileB.txt
2024/11/07 01:18:58 NOTICE: (13)  : test = file      - path1      - path2      - expected action    - who wins
2024/11/07 01:18:58 NOTICE: (14)  : test - file1.txt - exists     - missing    - sync path1 > path2 - path1
2024/11/07 01:18:58 NOTICE: (15)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/file1.txt
2024/11/07 01:18:58 INFO  : file1.txt: Deleted
2024/11/07 01:18:58 NOTICE: (16)  : test - file2.txt - missing    - exists     - copy path2 > path1 - path2
2024/11/07 01:18:58 NOTICE: (17)  : delete-file /tmp/011847xi/resync/path1/file2.txt
2024/11/07 01:18:58 INFO  : file2.txt: Deleted
2024/11/07 01:18:58 NOTICE: (18)  : test - file3.txt - exists     - newer date - sync path1 > path2 - path1
2024/11/07 01:18:58 NOTICE: (19)  : copy-as /tmp/011847xi/datadir/test_resync-yifuwit9/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/ file3.txt
2024/11/07 01:18:58 INFO  : fileA.txt: Copied (replaced existing) to: file3.txt
2024/11/07 01:18:58 NOTICE: (20)  : test - file4.txt - missing    - newer date - copy path2 > path1 - path2
2024/11/07 01:18:58 NOTICE: (21)  : delete-file /tmp/011847xi/resync/path1/file4.txt
2024/11/07 01:18:58 INFO  : file4.txt: Deleted
2024/11/07 01:18:58 NOTICE: (22)  : copy-as /tmp/011847xi/datadir/test_resync-yifuwit9/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/ file4.txt
2024/11/07 01:18:58 INFO  : fileA.txt: Copied (replaced existing) to: file4.txt
2024/11/07 01:18:58 NOTICE: (23)  : test - file5.txt - exists     - older date - sync path1 > path2 - path1
2024/11/07 01:18:58 NOTICE: (24)  : copy-as /tmp/011847xi/datadir/test_resync-yifuwit9/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/ file5.txt
2024/11/07 01:18:58 INFO  : fileB.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:18:58 NOTICE: (25)  : test - file6.txt - older date - newer date - sync path1 > path2	- path1
2024/11/07 01:18:58 NOTICE: (26)  : copy-as /tmp/011847xi/datadir/test_resync-yifuwit9/fileB.txt /tmp/011847xi/resync/path1/ file6.txt
2024/11/07 01:18:58 INFO  : fileB.txt: Copied (replaced existing) to: file6.txt
2024/11/07 01:18:58 NOTICE: (27)  : copy-as /tmp/011847xi/datadir/test_resync-yifuwit9/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/ file6.txt
2024/11/07 01:18:58 INFO  : fileA.txt: Copied (replaced existing) to: file6.txt
2024/11/07 01:18:58 NOTICE: (28)  : test - file7.txt - exists     - exists (same) - none            - same
2024/11/07 01:18:58 NOTICE: (29)  : test run bisync with resync
2024/11/07 01:18:58 NOTICE: (30)  : bisync resync
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:58 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : file3.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : file5.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (31)  : copy-listings mixed-diffs
2024/11/07 01:18:58 NOTICE: (32)  : test run normal bisync
2024/11/07 01:18:58 NOTICE: (33)  : bisync
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:58 INFO  : Path1 checking for diffs
2024/11/07 01:18:58 INFO  : Path2 checking for diffs
2024/11/07 01:18:58 INFO  : No changes found
2024/11/07 01:18:58 INFO  : Updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (34)  : test 4. confirm critical error on normal sync of empty path.
2024/11/07 01:18:58 NOTICE: (35)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync/path2/
2024/11/07 01:18:58 NOTICE: (36)  : bisync
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync/path2/"
2024/11/07 01:18:58 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:58 INFO  : Path1 checking for diffs
2024/11/07 01:18:58 INFO  : Path2 checking for diffs
2024/11/07 01:18:58 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/011847xi/workdir/tmp_011847xi_resync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_resync_path2.path2.lst-new
2024/11/07 01:18:58 ERROR : Bisync critical error: empty current Path2 listing: /tmp/011847xi/workdir/tmp_011847xi_resync_path1..TestHdfs_rclone-test-zedewoz4gosi_011847xi_resync_path2.path2.lst-new
2024/11/07 01:18:58 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:18:58 NOTICE: Bisync error: bisync aborted
    bisync_test.go:558: TEST resync PASSED
=== RUN   TestBisyncLocalRemote/resync_modes
2024/11/07 01:18:58 DEBUG : Creating backend with remote "/tmp/011847xi/resync_modes/path1"
2024/11/07 01:18:58 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:58 DEBUG : path2: Making directory
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:58 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2"
2024/11/07 01:18:58 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:58 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:58 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:58 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:58 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2"
2024/11/07 01:18:58 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_resync_modes-juvewap8"
2024/11/07 01:18:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:58 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : Local file system at /tmp/011847xi/initdir/test_resync_modes-juvewap8: Waiting for checks to finish
2024/11/07 01:18:58 DEBUG : Local file system at /tmp/011847xi/initdir/test_resync_modes-juvewap8: Waiting for transfers to finish
2024/11/07 01:18:58 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:58 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:58 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:58 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:58 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_resync_modes-limerew2"
2024/11/07 01:18:58 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : Local file system at /tmp/011847xi/datadir/test_resync_modes-limerew2: Waiting for checks to finish
2024/11/07 01:18:58 DEBUG : Local file system at /tmp/011847xi/datadir/test_resync_modes-limerew2: Waiting for transfers to finish
2024/11/07 01:18:58 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:18:58 DEBUG : file1L.txt.7d07f91a.partial: renamed to: file1L.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:18:58 DEBUG : file2.txt.7cc9b07.partial: renamed to: file2.txt
2024/11/07 01:18:58 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : file1R.txt.cb75035e.partial: renamed to: file1R.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (new)
2024/11/07 01:18:58 ERROR : : error listing: directory not found
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: list [/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2]
2024/11/07 01:18:58 ERROR : : error listing: directory not found
2024/11/07 01:18:58 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_resync_modes-juvewap8
2024/11/07 01:18:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : Local file system at /tmp/011847xi/resync_modes/path1: Waiting for checks to finish
2024/11/07 01:18:58 DEBUG : Local file system at /tmp/011847xi/resync_modes/path1: Waiting for transfers to finish
2024/11/07 01:18:58 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:58 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:58 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:58 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:58 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:58 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:58 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:58 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 NOTICE: checking Path1 Local file system at /tmp/011847xi/resync_modes/path1
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: list [/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2]
2024/11/07 01:18:58 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/RCLONE_TEST]
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/file1.txt]
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: update [/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/file2.txt]
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: Waiting for checks to finish
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: Waiting for transfers to finish
2024/11/07 01:18:58 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:58 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:58 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:58 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2
2024/11/07 01:18:58 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2: list [/rclone-test-zedewoz4gosi/011847xi/resync_modes/path2]
2024/11/07 01:18:58 NOTICE: (01)  : test resync-mode
2024/11/07 01:18:58 NOTICE: (02)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:58 NOTICE: (03)  : touch-glob 2001-01-02 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:58 NOTICE: (04)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (05)  : touch-glob 2001-03-04 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:58 NOTICE: (06)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (07)  : test bisync run with --resync-mode=newer
2024/11/07 01:18:58 NOTICE: (08)  : bisync resync resync-mode=newer
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (09)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:58 NOTICE: (10)  : touch-glob 2001-07-23 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:58 NOTICE: (11)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (12)  : touch-glob 2001-08-26 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:58 NOTICE: (13)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Updated modification time in destination
2024/11/07 01:18:58 NOTICE: (14)  : test bisync run with --resync-mode=path2
2024/11/07 01:18:58 NOTICE: (15)  : bisync resync resync-mode=path2
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (16)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:58 NOTICE: (17)  : touch-glob 2002-07-23 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:58 NOTICE: (18)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (19)  : touch-glob 2002-08-26 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:58 NOTICE: (20)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (21)  : test bisync run with --resync-mode=larger
2024/11/07 01:18:58 NOTICE: (22)  : bisync resync resync-mode=larger
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:18:58 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (23)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:58 NOTICE: (24)  : touch-glob 2003-07-23 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:58 NOTICE: (25)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (26)  : touch-glob 2003-09-04 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:58 NOTICE: (27)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (28)  : test bisync run with --resync-mode=older
2024/11/07 01:18:58 NOTICE: (29)  : bisync resync resync-mode=older
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s
2024/11/07 01:18:58 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (30)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:58 NOTICE: (31)  : touch-glob 2004-07-23 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:58 NOTICE: (32)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (33)  : touch-glob 2004-07-23 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:58 NOTICE: (34)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (35)  : test bisync run with --resync-mode=smaller
2024/11/07 01:18:58 NOTICE: (36)  : bisync resync resync-mode=smaller
2024/11/07 01:18:58 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:58 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:58 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:58 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:58 INFO  : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:18:58 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:58 INFO  : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:18:58 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:58 INFO  : Resync updating listings
2024/11/07 01:18:58 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:58 INFO  : Bisync successful
2024/11/07 01:18:58 NOTICE: (37)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:18:58 NOTICE: (38)  : touch-glob 2005-01-02 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:58 NOTICE: (39)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:58 NOTICE: (40)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt /tmp/011847xi/resync_modes/path1/ file2.txt
2024/11/07 01:18:58 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:58 NOTICE: (41)  : touch-glob 2006-03-04 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:58 NOTICE: (42)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:58 INFO  : file1L.txt: Updated modification time in destination
2024/11/07 01:18:58 NOTICE: (43)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file2.txt
2024/11/07 01:18:59 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:59 NOTICE: (44)  : test bisync run with --resync-mode=path1
2024/11/07 01:18:59 NOTICE: (45)  : bisync resync resync-mode=path1
2024/11/07 01:18:59 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:59 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:59 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:59 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:59 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:59 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:59 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:59 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:59 INFO  : Resync updating listings
2024/11/07 01:18:59 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:59 INFO  : Bisync successful
2024/11/07 01:18:59 NOTICE: (46)  : test no winner
2024/11/07 01:18:59 NOTICE: (47)  : touch-glob 2022-02-22 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1R.txt
2024/11/07 01:18:59 NOTICE: (48)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file1.txt
2024/11/07 01:18:59 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:18:59 NOTICE: (49)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1R.txt /tmp/011847xi/resync_modes/path1/ file2.txt
2024/11/07 01:18:59 INFO  : file1R.txt: Updated modification time in destination
2024/11/07 01:18:59 NOTICE: (50)  : touch-glob 2022-02-22 /tmp/011847xi/datadir/test_resync_modes-limerew2/ file1L.txt
2024/11/07 01:18:59 NOTICE: (51)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt /tmp/011847xi/resync_modes/path1/ file1.txt
2024/11/07 01:18:59 INFO  : file1L.txt: Updated modification time in destination
2024/11/07 01:18:59 NOTICE: (52)  : copy-as /tmp/011847xi/datadir/test_resync_modes-limerew2/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/ file2.txt
2024/11/07 01:18:59 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:18:59 NOTICE: (53)  : test bisync run with --resync-mode=newer
2024/11/07 01:18:59 NOTICE: (54)  : bisync resync resync-mode=newer
2024/11/07 01:18:59 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:59 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:59 INFO  : Synching Path1 "/tmp/011847xi/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:59 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:59 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:59 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:18:59 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:18:59 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:59 INFO  : Resync updating listings
2024/11/07 01:18:59 INFO  : Validating listings for Path1 "/tmp/011847xi/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/resync_modes/path2/"
2024/11/07 01:18:59 INFO  : Bisync successful
    bisync_test.go:558: TEST resync_modes PASSED
=== RUN   TestBisyncLocalRemote/rmdirs
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011847xi/rmdirs/path1"
2024/11/07 01:18:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:59 DEBUG : path2: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2"
2024/11/07 01:18:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2"
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_rmdirs-wefakid0"
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:59 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:59 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:59 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:59 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:59 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/initdir/test_rmdirs-wefakid0: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/initdir/test_rmdirs-wefakid0: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:59 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:59 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:59 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_rmdirs-kefitoj2"
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/datadir/test_rmdirs-kefitoj2: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/datadir/test_rmdirs-kefitoj2: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:59 DEBUG : file1.txt.13f42ab5.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 ERROR : : error listing: directory not found
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2]
2024/11/07 01:18:59 ERROR : : error listing: directory not found
2024/11/07 01:18:59 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_rmdirs-wefakid0
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:59 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:59 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:59 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:59 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:59 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/rmdirs/path1: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/rmdirs/path1: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:59 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:59 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:59 NOTICE: checking Path1 Local file system at /tmp/011847xi/rmdirs/path1
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2]
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : subdir: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: mkdir [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/subdir]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/RCLONE_TEST]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/file1.copy1.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/file1.copy2.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/file1.copy3.txt]
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: Waiting for transfers to finish
2024/11/07 01:18:59 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/file1.copy4.txt]
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/file1.copy5.txt]
2024/11/07 01:18:59 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/file1.txt]
2024/11/07 01:18:59 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: update [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/subdir/file20.txt]
2024/11/07 01:18:59 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:59 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2: list [/rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/subdir]
2024/11/07 01:18:59 NOTICE: (01)  : test rmdirs
2024/11/07 01:18:59 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:59 NOTICE: (03)  : bisync resync
2024/11/07 01:18:59 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:59 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:59 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:59 INFO  : Synching Path1 "/tmp/011847xi/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/"
2024/11/07 01:18:59 INFO  : Copying Path2 files to Path1
2024/11/07 01:18:59 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:18:59 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:18:59 INFO  : Resync updating listings
2024/11/07 01:18:59 INFO  : Validating listings for Path1 "/tmp/011847xi/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/"
2024/11/07 01:18:59 INFO  : Bisync successful
2024/11/07 01:18:59 NOTICE: (04)  : test 1. delete path1 subdir file
2024/11/07 01:18:59 NOTICE: (05)  : delete-file /tmp/011847xi/rmdirs/path1/subdir/file20.txt
2024/11/07 01:18:59 INFO  : file20.txt: Deleted
2024/11/07 01:18:59 NOTICE: (06)  : test 2. run bisync without remove-empty-dirs
2024/11/07 01:18:59 NOTICE: (07)  : bisync
2024/11/07 01:18:59 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:59 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:59 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:59 INFO  : Synching Path1 "/tmp/011847xi/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/"
2024/11/07 01:18:59 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:59 INFO  : Path1 checking for diffs
2024/11/07 01:18:59 INFO  : - Path1    File was deleted          - subdir/file20.txt
2024/11/07 01:18:59 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:18:59 INFO  : Path2 checking for diffs
2024/11/07 01:18:59 INFO  : Applying changes
2024/11/07 01:18:59 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/subdir/file20.txt
2024/11/07 01:18:59 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:18:59 INFO  : subdir/file20.txt: Deleted
2024/11/07 01:18:59 INFO  : Updating listings
2024/11/07 01:18:59 INFO  : Validating listings for Path1 "/tmp/011847xi/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/"
2024/11/07 01:18:59 INFO  : Bisync successful
2024/11/07 01:18:59 NOTICE: (08)  : test 3. confirm the subdir still exists on both paths
2024/11/07 01:18:59 NOTICE: (09)  : list-dirs /tmp/011847xi/rmdirs/path1/
2024/11/07 01:18:59 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:59 NOTICE: (10)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/
2024/11/07 01:18:59 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:18:59 NOTICE: (11)  : test 4. run bisync with remove-empty-dirs
2024/11/07 01:18:59 NOTICE: (12)  : bisync remove-empty-dirs
2024/11/07 01:18:59 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:59 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:18:59 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": true,
	"DownloadHash": false
}
2024/11/07 01:18:59 INFO  : Synching Path1 "/tmp/011847xi/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/"
2024/11/07 01:18:59 INFO  : Building Path1 and Path2 listings
2024/11/07 01:18:59 INFO  : Path1 checking for diffs
2024/11/07 01:18:59 INFO  : Path2 checking for diffs
2024/11/07 01:18:59 INFO  : No changes found
2024/11/07 01:18:59 INFO  : Updating listings
2024/11/07 01:18:59 INFO  : Validating listings for Path1 "/tmp/011847xi/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/"
2024/11/07 01:18:59 INFO  : Removing empty directories
2024/11/07 01:18:59 INFO  : subdir: Removing directory
2024/11/07 01:18:59 INFO  : subdir: Removing directory
2024/11/07 01:18:59 INFO  : Bisync successful
2024/11/07 01:18:59 NOTICE: (13)  : test 5. confirm the subdir has been removed on both paths
2024/11/07 01:18:59 NOTICE: (14)  : list-dirs /tmp/011847xi/rmdirs/path1/
2024/11/07 01:18:59 NOTICE: (15)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-zedewoz4gosi/011847xi/rmdirs/path2/
    bisync_test.go:558: TEST rmdirs PASSED
=== RUN   TestBisyncLocalRemote/volatile
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011847xi/volatile/path1"
2024/11/07 01:18:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-zedewoz4gosi/011847xi" for canonical name "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi"
2024/11/07 01:18:59 DEBUG : path2: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi: mkdir [/rclone-test-zedewoz4gosi/011847xi/path2]
2024/11/07 01:18:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-zedewoz4gosi/011847xi/volatile/path2"
2024/11/07 01:18:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-zedewoz4gosi/011847xi/volatile/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-zedewoz4gosi/011847xi/volatile/path2"
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011847xi/initdir/test_volatile-nadoloy4"
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:59 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:59 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/initdir/test_volatile-nadoloy4: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/initdir/test_volatile-nadoloy4: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:59 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:59 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:59 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:59 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:59 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011847xi/datadir/test_volatile-foyidoy5"
2024/11/07 01:18:59 DEBUG : dummy.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:59 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.txt.ae546193.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : dummy.txt.75bafa33.partial: renamed to: dummy.txt
2024/11/07 01:18:59 INFO  : dummy.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:18:59 DEBUG : file2.txt.8872da9c.partial: renamed to: file2.txt
2024/11/07 01:18:59 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:18:59 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:18:59 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:18:59 INFO  : file5R.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:18:59 INFO  : file5L.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:59 DEBUG : file11.txt.ae546193.partial: renamed to: file11.txt
2024/11/07 01:18:59 INFO  : file11.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/datadir/test_volatile-foyidoy5: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/datadir/test_volatile-foyidoy5: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : file6.txt.ae546193.partial: renamed to: file6.txt
2024/11/07 01:18:59 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:59 DEBUG : file10.txt.ae546193.partial: renamed to: file10.txt
2024/11/07 01:18:59 INFO  : file10.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:18:59 DEBUG : file7.txt.6bedbe24.partial: renamed to: file7.txt
2024/11/07 01:18:59 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:59 ERROR : : error listing: directory not found
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: list [/rclone-test-zedewoz4gosi/011847xi/volatile/path2]
2024/11/07 01:18:59 ERROR : : error listing: directory not found
2024/11/07 01:18:59 NOTICE: checking initFs Local file system at /tmp/011847xi/initdir/test_volatile-nadoloy4
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:18:59 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:18:59 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:18:59 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:18:59 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:18:59 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:18:59 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:18:59 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/volatile/path1: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011847xi/volatile/path1: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 NOTICE: checking Path1 Local file system at /tmp/011847xi/volatile/path1
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: list [/rclone-test-zedewoz4gosi/011847xi/volatile/path2]
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/RCLONE_TEST]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file1.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file2.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file3.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: Waiting for transfers to finish
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file4.txt]
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file5.txt]
2024/11/07 01:18:59 INFO  : file2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file6.txt]
2024/11/07 01:18:59 INFO  : file3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file7.txt]
2024/11/07 01:18:59 INFO  : file4.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: update [/rclone-test-zedewoz4gosi/011847xi/volatile/path2/file8.txt]
2024/11/07 01:18:59 INFO  : file5.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file6.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file7.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file8.txt: Copied (new)
2024/11/07 01:18:59 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi/011847xi/volatile/path2: list [/rclone-test-zedewoz4gosi/011847xi/volatile/path2]
2024/11/07 01:18:59 NOTICE: (01)  : test volatile
2024/11/07 01:18:59 NOTICE: (02)  : test initial bisync
2024/11/07 01:18:59 NOTICE: (03)  : bisync resync
    bisync_test.go:926: skipping 'volatile' test on non-local as it requires uploading 100 files
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi: Purge remote
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-zedewoz4gosi: purge [/rclone-test-zedewoz4gosi]
--- PASS: TestBisyncLocalRemote (11.94s)
    --- PASS: TestBisyncLocalRemote/all_changed (0.66s)
    --- SKIP: TestBisyncLocalRemote/backupdir (0.21s)
    --- PASS: TestBisyncLocalRemote/basic (0.30s)
    --- PASS: TestBisyncLocalRemote/changes (0.51s)
    --- PASS: TestBisyncLocalRemote/check_access (0.56s)
    --- PASS: TestBisyncLocalRemote/check_access_filters (0.96s)
    --- PASS: TestBisyncLocalRemote/check_filename (0.30s)
    --- PASS: TestBisyncLocalRemote/check_sync (0.39s)
    --- PASS: TestBisyncLocalRemote/compare_all (0.52s)
    --- PASS: TestBisyncLocalRemote/createemptysrcdirs (0.51s)
    --- PASS: TestBisyncLocalRemote/dry_run (0.58s)
    --- PASS: TestBisyncLocalRemote/equal (0.24s)
    --- PASS: TestBisyncLocalRemote/ext_paths (0.55s)
    --- SKIP: TestBisyncLocalRemote/extended_filenames (0.33s)
    --- PASS: TestBisyncLocalRemote/filters (0.28s)
    --- PASS: TestBisyncLocalRemote/filtersfile_checks (0.36s)
    --- PASS: TestBisyncLocalRemote/ignorelistingchecksum (0.30s)
    --- PASS: TestBisyncLocalRemote/max_delete_path1 (0.32s)
    --- PASS: TestBisyncLocalRemote/max_delete_path2_force (0.32s)
    --- PASS: TestBisyncLocalRemote/nomodtime (0.47s)
    --- SKIP: TestBisyncLocalRemote/normalization (0.29s)
    --- PASS: TestBisyncLocalRemote/rclone_args (0.64s)
    --- PASS: TestBisyncLocalRemote/resolve (0.52s)
    --- PASS: TestBisyncLocalRemote/resync (0.71s)
    --- PASS: TestBisyncLocalRemote/resync_modes (0.60s)
    --- PASS: TestBisyncLocalRemote/rmdirs (0.32s)
    --- SKIP: TestBisyncLocalRemote/volatile (0.20s)
=== RUN   TestBisyncRemoteRemote
2024/11/07 01:18:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo"
2024/11/07 01:18:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 NOTICE: remote: TestHdfs:rclone-test-ruzotid9vaxo
=== RUN   TestBisyncRemoteRemote/all_changed
2024/11/07 01:18:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:18:59 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2024/11/07 01:18:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:18:59 DEBUG : path1: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:18:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1"
2024/11/07 01:18:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1"
2024/11/07 01:18:59 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:18:59 DEBUG : path2: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:18:59 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2"
2024/11/07 01:18:59 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:18:59 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:18:59 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:18:59 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2"
2024/11/07 01:18:59 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_all_changed-foqikuf1"
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : subdir: Making directory with metadata
2024/11/07 01:18:59 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:18:59 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011859lo/initdir/test_all_changed-foqikuf1: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : Local file system at /tmp/011859lo/initdir/test_all_changed-foqikuf1: Waiting for transfers to finish
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:18:59 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:18:59 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:18:59 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:18:59 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:18:59 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:18:59 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:59 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1]
2024/11/07 01:18:59 ERROR : : error listing: directory not found
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2]
2024/11/07 01:18:59 ERROR : : error listing: directory not found
2024/11/07 01:18:59 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_all_changed-foqikuf1
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1]
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : subdir: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/subdir]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/RCLONE_TEST]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/file1.copy1.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/file1.copy2.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/file1.copy3.txt]
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: Waiting for transfers to finish
2024/11/07 01:18:59 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/file1.copy4.txt]
2024/11/07 01:18:59 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/file1.copy5.txt]
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/file1.txt]
2024/11/07 01:18:59 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/subdir/file20.txt]
2024/11/07 01:18:59 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:18:59 INFO  : file1.txt: Copied (new)
2024/11/07 01:18:59 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:18:59 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/subdir]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2]
2024/11/07 01:18:59 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : subdir: Making directory
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/subdir]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/RCLONE_TEST]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy2.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy3.txt]
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy1.txt]
2024/11/07 01:18:59 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: Waiting for checks to finish
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: Waiting for transfers to finish
2024/11/07 01:18:59 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy4.txt]
2024/11/07 01:18:59 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy5.txt]
2024/11/07 01:18:59 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:18:59 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.txt]
2024/11/07 01:19:00 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: update [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/subdir/file20.txt]
2024/11/07 01:19:00 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:00 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:00 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2: list [/rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/subdir]
2024/11/07 01:19:00 NOTICE: (01)  : test all-changed
2024/11/07 01:19:00 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:00 NOTICE: (03)  : bisync resync
2024/11/07 01:19:00 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:00 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:00 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:00 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:00 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:00 INFO  : Resync updating listings
2024/11/07 01:19:00 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Bisync successful
2024/11/07 01:19:00 NOTICE: (04)  : test change timestamp on all files except RCLONE_TEST
2024/11/07 01:19:00 NOTICE: (05)  : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/ file*
2024/11/07 01:19:00 NOTICE: (06)  : touch-glob 2005-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/subdir file*
2024/11/07 01:19:00 NOTICE: (07)  : test sync should pass
2024/11/07 01:19:00 NOTICE: (08)  : bisync
2024/11/07 01:19:00 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:00 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:00 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:00 INFO  : Path1 checking for diffs
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - file1.copy1.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - file1.copy2.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - file1.copy3.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - file1.copy4.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - file1.copy5.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - subdir/file20.txt
2024/11/07 01:19:00 INFO  : Path1:    7 changes:    0 new,    7 modified,    0 deleted
2024/11/07 01:19:00 INFO  : (Modified:    7 newer,    0 older)
2024/11/07 01:19:00 INFO  : Path2 checking for diffs
2024/11/07 01:19:00 INFO  : Applying changes
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy1.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy2.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy3.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy4.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy5.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/subdir/file20.txt
2024/11/07 01:19:00 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:00 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : Updating listings
2024/11/07 01:19:00 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Bisync successful
2024/11/07 01:19:00 NOTICE: (09)  : test change timestamp on all files including RCLONE_TEST
2024/11/07 01:19:00 NOTICE: (10)  : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/ *
2024/11/07 01:19:00 NOTICE: (11)  : touch-glob 2004-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/subdir *
2024/11/07 01:19:00 NOTICE: (12)  : test sync should fail
2024/11/07 01:19:00 NOTICE: (13)  : bisync
2024/11/07 01:19:00 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:00 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:00 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:00 INFO  : Path1 checking for diffs
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - RCLONE_TEST
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy1.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy2.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy3.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy4.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy5.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - subdir/file20.txt
2024/11/07 01:19:00 INFO  : Path1:    8 changes:    0 new,    8 modified,    0 deleted
2024/11/07 01:19:00 INFO  : (Modified:    1 newer,    7 older)
2024/11/07 01:19:00 INFO  : Path2 checking for diffs
2024/11/07 01:19:00 ERROR : Safety abort: all files were changed on Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/". Run with --force if desired.
2024/11/07 01:19:00 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:19:00 NOTICE: Bisync error: all files were changed
2024/11/07 01:19:00 NOTICE: (14)  : test sync with force should pass
2024/11/07 01:19:00 NOTICE: (15)  : bisync force
2024/11/07 01:19:00 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:00 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:00 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:00 INFO  : Path1 checking for diffs
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (newer) - RCLONE_TEST
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy1.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy2.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy3.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy4.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.copy5.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - file1.txt
2024/11/07 01:19:00 INFO  : - Path1    File changed: time (older) - subdir/file20.txt
2024/11/07 01:19:00 INFO  : Path1:    8 changes:    0 new,    8 modified,    0 deleted
2024/11/07 01:19:00 INFO  : (Modified:    1 newer,    7 older)
2024/11/07 01:19:00 INFO  : Path2 checking for diffs
2024/11/07 01:19:00 INFO  : Applying changes
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/RCLONE_TEST
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy1.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy2.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy3.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy4.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.copy5.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/file1.txt
2024/11/07 01:19:00 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/subdir/file20.txt
2024/11/07 01:19:00 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:00 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : RCLONE_TEST: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:19:00 INFO  : Updating listings
2024/11/07 01:19:00 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/all_changed/path2/"
2024/11/07 01:19:00 INFO  : Bisync successful
    bisync_test.go:558: TEST all_changed PASSED
=== RUN   TestBisyncRemoteRemote/backupdir
2024/11/07 01:19:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:00 DEBUG : path1: Making directory
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/backupdir/path1"
2024/11/07 01:19:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/backupdir/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/backupdir/path1"
2024/11/07 01:19:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:00 DEBUG : path2: Making directory
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/backupdir/path2"
2024/11/07 01:19:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/backupdir/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/backupdir/path2"
2024/11/07 01:19:00 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_backupdir-nizonih8"
2024/11/07 01:19:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:00 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:00 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:00 DEBUG : Local file system at /tmp/011859lo/initdir/test_backupdir-nizonih8: Waiting for checks to finish
2024/11/07 01:19:00 DEBUG : Local file system at /tmp/011859lo/initdir/test_backupdir-nizonih8: Waiting for transfers to finish
2024/11/07 01:19:00 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:00 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:00 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:00 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:00 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:00 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:00 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:00 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:00 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_backupdir-puyumal5"
2024/11/07 01:19:00 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : Local file system at /tmp/011859lo/datadir/test_backupdir-puyumal5: Waiting for checks to finish
2024/11/07 01:19:00 DEBUG : Local file system at /tmp/011859lo/datadir/test_backupdir-puyumal5: Waiting for transfers to finish
2024/11/07 01:19:00 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:00 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:00 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:00 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:19:00 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:19:00 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:19:00 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:00 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:19:00 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:19:00 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:19:00 INFO  : file5L.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:00 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:19:00 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:19:00 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:19:00 INFO  : file5R.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:00 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:19:00 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: list [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1]
2024/11/07 01:19:00 ERROR : : error listing: directory not found
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: list [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2]
2024/11/07 01:19:00 ERROR : : error listing: directory not found
2024/11/07 01:19:00 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_backupdir-nizonih8
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: list [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1]
2024/11/07 01:19:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/RCLONE_TEST]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file1.txt]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file2.txt]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: Waiting for checks to finish
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: Waiting for transfers to finish
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file3.txt]
2024/11/07 01:19:00 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file4.txt]
2024/11/07 01:19:00 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file5.txt]
2024/11/07 01:19:00 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file6.txt]
2024/11/07 01:19:00 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file7.txt]
2024/11/07 01:19:00 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1/file8.txt]
2024/11/07 01:19:00 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:00 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1: list [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path1]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: list [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2]
2024/11/07 01:19:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/RCLONE_TEST]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: Waiting for checks to finish
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: Waiting for transfers to finish
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file3.txt]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file1.txt]
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file2.txt]
2024/11/07 01:19:00 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file4.txt]
2024/11/07 01:19:00 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file5.txt]
2024/11/07 01:19:00 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file6.txt]
2024/11/07 01:19:00 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file7.txt]
2024/11/07 01:19:00 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: update [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2/file8.txt]
2024/11/07 01:19:00 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:00 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:00 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2: list [/rclone-test-ruzotid9vaxo/011859lo/backupdir/path2]
2024/11/07 01:19:00 NOTICE: (01)  : test backupdir
2024/11/07 01:19:00 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:00 NOTICE: (03)  : bisync resync backupdir1=/tmp/011859lo/workdir/backupdirs/backupdir1 backupdir2=/tmp/011859lo/workdir/backupdirs/backupdir2
    bisync_test.go:923: backupdir test currently only works on local (it uses the workdir)
=== RUN   TestBisyncRemoteRemote/basic
2024/11/07 01:19:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:00 DEBUG : path1: Making directory
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/basic/path1"
2024/11/07 01:19:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/basic/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path1"
2024/11/07 01:19:00 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:00 DEBUG : path2: Making directory
2024/11/07 01:19:00 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:00 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/basic/path2"
2024/11/07 01:19:00 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:00 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:00 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:00 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/basic/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path2"
2024/11/07 01:19:00 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_basic-roluxex6"
2024/11/07 01:19:00 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:00 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:00 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:00 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:00 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:19:00 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:19:00 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : Local file system at /tmp/011859lo/initdir/test_basic-roluxex6: Waiting for checks to finish
2024/11/07 01:19:00 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:00 DEBUG : Local file system at /tmp/011859lo/initdir/test_basic-roluxex6: Waiting for transfers to finish
2024/11/07 01:19:00 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:19:00 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:19:00 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:00 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:00 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:19:00 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:00 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:00 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:00 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:00 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:00 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_basic-leruhup4"
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : Local file system at /tmp/011859lo/datadir/test_basic-leruhup4: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : Local file system at /tmp/011859lo/datadir/test_basic-leruhup4: Waiting for transfers to finish
2024/11/07 01:19:01 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:01 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path1]
2024/11/07 01:19:01 ERROR : : error listing: directory not found
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path2]
2024/11/07 01:19:01 ERROR : : error listing: directory not found
2024/11/07 01:19:01 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_basic-roluxex6
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path1]
2024/11/07 01:19:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : subdir: Making directory
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/subdir]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/RCLONE_TEST]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.copy1.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.copy2.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.copy3.txt]
2024/11/07 01:19:01 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: Waiting for transfers to finish
2024/11/07 01:19:01 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.copy4.txt]
2024/11/07 01:19:01 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.copy5.txt]
2024/11/07 01:19:01 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.txt]
2024/11/07 01:19:01 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/subdir/file20.txt]
2024/11/07 01:19:01 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:01 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path1]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path1: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path1/subdir]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path2]
2024/11/07 01:19:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : subdir: Making directory
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/subdir]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/RCLONE_TEST]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/file1.copy1.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/file1.copy2.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/file1.copy3.txt]
2024/11/07 01:19:01 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: Waiting for transfers to finish
2024/11/07 01:19:01 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/file1.copy4.txt]
2024/11/07 01:19:01 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/file1.copy5.txt]
2024/11/07 01:19:01 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/file1.txt]
2024/11/07 01:19:01 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: update [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/subdir/file20.txt]
2024/11/07 01:19:01 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:01 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:01 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path2]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/basic/path2: list [/rclone-test-ruzotid9vaxo/011859lo/basic/path2/subdir]
2024/11/07 01:19:01 NOTICE: (01)  : test basic
2024/11/07 01:19:01 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:01 NOTICE: (03)  : bisync resync
2024/11/07 01:19:01 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:01 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:01 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path2/"
2024/11/07 01:19:01 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:01 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:01 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:01 INFO  : Resync updating listings
2024/11/07 01:19:01 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path2/"
2024/11/07 01:19:01 INFO  : Bisync successful
2024/11/07 01:19:01 NOTICE: (04)  : test place newer files on both paths
2024/11/07 01:19:01 NOTICE: (05)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_basic-leruhup4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/basic/path2/
2024/11/07 01:19:01 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:01 NOTICE: (06)  : copy-as /tmp/011859lo/datadir/test_basic-leruhup4/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/basic/path1/subdir file20.txt
2024/11/07 01:19:01 INFO  : file1.txt: Copied (replaced existing) to: file20.txt
2024/11/07 01:19:01 NOTICE: (07)  : test bisync run
2024/11/07 01:19:01 NOTICE: (08)  : bisync
2024/11/07 01:19:01 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:01 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:01 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path2/"
2024/11/07 01:19:01 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:01 INFO  : Path1 checking for diffs
2024/11/07 01:19:01 INFO  : - Path1    File changed: size (larger), time (newer) - subdir/file20.txt
2024/11/07 01:19:01 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:01 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:01 INFO  : Path2 checking for diffs
2024/11/07 01:19:01 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:01 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:01 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:01 INFO  : Applying changes
2024/11/07 01:19:01 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path2/subdir/file20.txt
2024/11/07 01:19:01 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path1/file1.txt
2024/11/07 01:19:01 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:01 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:01 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:01 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:19:01 INFO  : Updating listings
2024/11/07 01:19:01 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/basic/path2/"
2024/11/07 01:19:01 INFO  : Bisync successful
    bisync_test.go:558: TEST basic PASSED
=== RUN   TestBisyncRemoteRemote/changes
2024/11/07 01:19:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:01 DEBUG : path1: Making directory
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/changes/path1"
2024/11/07 01:19:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/changes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1"
2024/11/07 01:19:01 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:01 DEBUG : path2: Making directory
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:01 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/changes/path2"
2024/11/07 01:19:01 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:01 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:01 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:01 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:01 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/changes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2"
2024/11/07 01:19:01 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_changes-faferen9"
2024/11/07 01:19:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:01 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : Local file system at /tmp/011859lo/initdir/test_changes-faferen9: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : Local file system at /tmp/011859lo/initdir/test_changes-faferen9: Waiting for transfers to finish
2024/11/07 01:19:01 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:01 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:01 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:01 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:01 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:01 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:01 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:01 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:01 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:01 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:01 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_changes-vediyem0"
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : Local file system at /tmp/011859lo/datadir/test_changes-vediyem0: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : Local file system at /tmp/011859lo/datadir/test_changes-vediyem0: Waiting for transfers to finish
2024/11/07 01:19:01 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:01 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:19:01 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:19:01 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:19:01 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:01 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:01 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:19:01 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:19:01 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:19:01 INFO  : file5R.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:19:01 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:19:01 INFO  : file5L.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:01 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:19:01 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:01 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:19:01 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: list [/rclone-test-ruzotid9vaxo/011859lo/changes/path1]
2024/11/07 01:19:01 ERROR : : error listing: directory not found
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: list [/rclone-test-ruzotid9vaxo/011859lo/changes/path2]
2024/11/07 01:19:01 ERROR : : error listing: directory not found
2024/11/07 01:19:01 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_changes-faferen9
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: list [/rclone-test-ruzotid9vaxo/011859lo/changes/path1]
2024/11/07 01:19:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/RCLONE_TEST]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file1.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file2.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file3.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: Waiting for transfers to finish
2024/11/07 01:19:01 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file4.txt]
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file5.txt]
2024/11/07 01:19:01 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file6.txt]
2024/11/07 01:19:01 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file7.txt]
2024/11/07 01:19:01 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path1/file8.txt]
2024/11/07 01:19:01 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:01 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path1: list [/rclone-test-ruzotid9vaxo/011859lo/changes/path1]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: list [/rclone-test-ruzotid9vaxo/011859lo/changes/path2]
2024/11/07 01:19:01 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/RCLONE_TEST]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file1.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file2.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file3.txt]
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: Waiting for checks to finish
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: Waiting for transfers to finish
2024/11/07 01:19:01 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file4.txt]
2024/11/07 01:19:01 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file5.txt]
2024/11/07 01:19:01 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file6.txt]
2024/11/07 01:19:01 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file7.txt]
2024/11/07 01:19:01 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/changes/path2/file8.txt]
2024/11/07 01:19:01 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:01 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:01 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2
2024/11/07 01:19:01 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: list [/rclone-test-ruzotid9vaxo/011859lo/changes/path2]
2024/11/07 01:19:01 NOTICE: (01)  : test changes
2024/11/07 01:19:01 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:01 NOTICE: (03)  : bisync resync
2024/11/07 01:19:01 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:01 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:01 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/"
2024/11/07 01:19:01 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:01 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:01 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:01 INFO  : Resync updating listings
2024/11/07 01:19:01 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/"
2024/11/07 01:19:01 INFO  : Bisync successful
2024/11/07 01:19:01 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:19:01 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:19:01 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/
2024/11/07 01:19:01 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:01 NOTICE: (07)  : test newer on path2 - file1
2024/11/07 01:19:01 NOTICE: (08)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/
2024/11/07 01:19:01 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:01 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:19:01 NOTICE: (10)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/
2024/11/07 01:19:01 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:01 NOTICE: (11)  : test newer on path1 - file2
2024/11/07 01:19:01 NOTICE: (12)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/
2024/11/07 01:19:01 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:01 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:19:01 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/file3.txt
2024/11/07 01:19:01 INFO  : file3.txt: Deleted
2024/11/07 01:19:01 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:19:01 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/file4.txt
2024/11/07 01:19:01 INFO  : file4.txt: Deleted
2024/11/07 01:19:01 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:19:01 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/file8.txt
2024/11/07 01:19:01 INFO  : file8.txt: Deleted
2024/11/07 01:19:01 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/file8.txt
2024/11/07 01:19:01 INFO  : file8.txt: Deleted
2024/11/07 01:19:01 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:19:01 NOTICE: (21)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/ file5R.txt
2024/11/07 01:19:01 NOTICE: (22)  : copy-as /tmp/011859lo/datadir/test_changes-vediyem0/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/ file5.txt
2024/11/07 01:19:01 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:01 NOTICE: (23)  : touch-glob 2001-03-04 /tmp/011859lo/datadir/test_changes-vediyem0/ file5L.txt
2024/11/07 01:19:01 NOTICE: (24)  : copy-as /tmp/011859lo/datadir/test_changes-vediyem0/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/ file5.txt
2024/11/07 01:19:01 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:01 NOTICE: (25)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:19:01 NOTICE: (26)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/
2024/11/07 01:19:01 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:19:01 NOTICE: (27)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/file6.txt
2024/11/07 01:19:01 INFO  : file6.txt: Deleted
2024/11/07 01:19:01 NOTICE: (28)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:19:01 NOTICE: (29)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_changes-vediyem0/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path1/
2024/11/07 01:19:01 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:19:01 NOTICE: (30)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/changes/path2/file7.txt
2024/11/07 01:19:01 INFO  : file7.txt: Deleted
2024/11/07 01:19:01 NOTICE: (31)  : test bisync run
2024/11/07 01:19:01 NOTICE: (32)  : bisync
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/"
2024/11/07 01:19:02 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:02 INFO  : Path1 checking for diffs
2024/11/07 01:19:02 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:02 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:19:02 INFO  : - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:19:02 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:19:02 INFO  : - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:19:02 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:19:02 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:19:02 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:19:02 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:19:02 INFO  : Path2 checking for diffs
2024/11/07 01:19:02 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:02 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:19:02 INFO  : - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:19:02 INFO  : - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:19:02 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:19:02 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:19:02 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:19:02 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:19:02 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:19:02 INFO  : Applying changes
2024/11/07 01:19:02 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:02 INFO  : Checking potential conflicts...
2024/11/07 01:19:02 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: 1 differences found
2024/11/07 01:19:02 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/changes/path2: 1 errors while checking
2024/11/07 01:19:02 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:02 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/file11.txt
2024/11/07 01:19:02 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/file2.txt
2024/11/07 01:19:02 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/file4.txt
2024/11/07 01:19:02 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:19:02 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/file5.txt.conflict1
2024/11/07 01:19:02 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:19:02 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/file5.txt.conflict1
2024/11/07 01:19:02 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/file5.txt.conflict2
2024/11/07 01:19:02 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:19:02 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/file5.txt.conflict2
2024/11/07 01:19:02 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/file6.txt
2024/11/07 01:19:02 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/file7.txt
2024/11/07 01:19:02 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/file1.txt
2024/11/07 01:19:02 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/file10.txt
2024/11/07 01:19:02 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/file3.txt
2024/11/07 01:19:02 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:02 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:02 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:19:02 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:02 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:02 INFO  : file3.txt: Deleted
2024/11/07 01:19:02 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:02 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:02 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:19:02 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:02 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:02 INFO  : file4.txt: Deleted
2024/11/07 01:19:02 INFO  : Updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/changes/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
    bisync_test.go:558: TEST changes PASSED
=== RUN   TestBisyncRemoteRemote/check_access
2024/11/07 01:19:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:02 DEBUG : path1: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access/path1"
2024/11/07 01:19:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1"
2024/11/07 01:19:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:02 DEBUG : path2: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access/path2"
2024/11/07 01:19:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2"
2024/11/07 01:19:02 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_check_access-dobesof4"
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:02 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:02 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:02 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:02 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:02 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:02 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_access-dobesof4: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_access-dobesof4: Waiting for transfers to finish
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_check_access-wipehaw0"
2024/11/07 01:19:02 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_access-wipehaw0: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_access-wipehaw0: Waiting for transfers to finish
2024/11/07 01:19:02 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:19:02 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:19:02 INFO  : hold.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1]
2024/11/07 01:19:02 ERROR : : error listing: directory not found
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2]
2024/11/07 01:19:02 ERROR : : error listing: directory not found
2024/11/07 01:19:02 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_check_access-dobesof4
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1]
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/subdir]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/RCLONE_TEST]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/file1.txt]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/file2.txt]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/file3.txt]
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: Waiting for transfers to finish
2024/11/07 01:19:02 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/file4.txt]
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/subdir/RCLONE_TEST]
2024/11/07 01:19:02 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/subdir/file20.txt]
2024/11/07 01:19:02 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:02 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:02 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:02 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path1/subdir]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2]
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/subdir]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/file1.txt]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/file2.txt]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/RCLONE_TEST]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/file3.txt]
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: Waiting for transfers to finish
2024/11/07 01:19:02 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/file4.txt]
2024/11/07 01:19:02 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/subdir/RCLONE_TEST]
2024/11/07 01:19:02 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/subdir/file20.txt]
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:02 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:02 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access/path2/subdir]
2024/11/07 01:19:02 NOTICE: (01)  : test check-access
2024/11/07 01:19:02 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:02 NOTICE: (03)  : bisync resync
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:02 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:02 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:02 INFO  : Resync updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
2024/11/07 01:19:02 NOTICE: (04)  : test 1. see that check-access passes with the initial setup
2024/11/07 01:19:02 NOTICE: (05)  : bisync check-access
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:02 INFO  : Path1 checking for diffs
2024/11/07 01:19:02 INFO  : Path2 checking for diffs
2024/11/07 01:19:02 INFO  : Checking access health
2024/11/07 01:19:02 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:02 INFO  : No changes found
2024/11/07 01:19:02 INFO  : Updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
2024/11/07 01:19:02 NOTICE: (06)  : test 2. delete the path2 subdir RCLONE_TEST and run sync. should fail critical.
2024/11/07 01:19:02 NOTICE: (07)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access/path2/subdir/RCLONE_TEST
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:02 NOTICE: (08)  : bisync check-access
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:02 INFO  : Path1 checking for diffs
2024/11/07 01:19:02 INFO  : Path2 checking for diffs
2024/11/07 01:19:02 INFO  : - Path2    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:19:02 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:02 INFO  : Checking access health
2024/11/07 01:19:02 ERROR : Access test failed: Path1 count 2, Path2 count 1 - RCLONE_TEST
2024/11/07 01:19:02 ERROR : -          Access test failed: Path1 file not found in Path2 - subdir/RCLONE_TEST
2024/11/07 01:19:02 ERROR : Bisync critical error: check file check failed
2024/11/07 01:19:02 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:02 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:02 NOTICE: (09)  : copy-listings path2-missing
2024/11/07 01:19:02 NOTICE: (10)  : test 3. put the path2 subdir RCLONE_TEST back, resync.
2024/11/07 01:19:02 NOTICE: (11)  : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access/path1/subdir/RCLONE_TEST TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access/path2/
2024/11/07 01:19:02 NOTICE: (12)  : bisync resync
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:02 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:02 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:02 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : Resync updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
2024/11/07 01:19:02 NOTICE: (13)  : test 4. run sync with check-access. should pass.
2024/11/07 01:19:02 NOTICE: (14)  : bisync check-access
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:02 INFO  : Path1 checking for diffs
2024/11/07 01:19:02 INFO  : Path2 checking for diffs
2024/11/07 01:19:02 INFO  : Checking access health
2024/11/07 01:19:02 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:02 INFO  : No changes found
2024/11/07 01:19:02 INFO  : Updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
2024/11/07 01:19:02 NOTICE: (15)  : test 5. delete path1 top level RCLONE_TEST, run sync. should fail critical.
2024/11/07 01:19:02 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access/path1/RCLONE_TEST
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:02 NOTICE: (17)  : bisync check-access
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:02 INFO  : Path1 checking for diffs
2024/11/07 01:19:02 INFO  : - Path1    File was deleted          - RCLONE_TEST
2024/11/07 01:19:02 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:02 INFO  : Path2 checking for diffs
2024/11/07 01:19:02 INFO  : Checking access health
2024/11/07 01:19:02 ERROR : Access test failed: Path1 count 1, Path2 count 2 - RCLONE_TEST
2024/11/07 01:19:02 ERROR : -          Access test failed: Path2 file not found in Path1 - RCLONE_TEST
2024/11/07 01:19:02 ERROR : Bisync critical error: check file check failed
2024/11/07 01:19:02 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:02 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:02 NOTICE: (18)  : copy-listings path1-missing
2024/11/07 01:19:02 NOTICE: (19)  : test 6. run again. should fail critical due to missing listings.
2024/11/07 01:19:02 NOTICE: (20)  : bisync check-access
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_access_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_access_path2.path1.lst
Path2: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_access_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_access_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011859lo/workdir"
2024/11/07 01:19:02 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:02 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:02 NOTICE: (21)  : move-listings missing-listings
2024/11/07 01:19:02 NOTICE: (22)  : test 7. run resync, which will copy the path2 top level back to path1.
2024/11/07 01:19:02 NOTICE: (23)  : bisync resync
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:02 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:02 INFO  : Resync updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
2024/11/07 01:19:02 NOTICE: (24)  : test 8. run sync with --check-access. should pass.
2024/11/07 01:19:02 NOTICE: (25)  : bisync check-access
2024/11/07 01:19:02 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:02 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:02 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:02 INFO  : Path1 checking for diffs
2024/11/07 01:19:02 INFO  : Path2 checking for diffs
2024/11/07 01:19:02 INFO  : Checking access health
2024/11/07 01:19:02 INFO  : Found 2 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:02 INFO  : No changes found
2024/11/07 01:19:02 INFO  : Updating listings
2024/11/07 01:19:02 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access/path2/"
2024/11/07 01:19:02 INFO  : Bisync successful
    bisync_test.go:558: TEST check_access PASSED
=== RUN   TestBisyncRemoteRemote/check_access_filters
2024/11/07 01:19:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:02 DEBUG : path1: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1"
2024/11/07 01:19:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1"
2024/11/07 01:19:02 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:02 DEBUG : path2: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:02 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2"
2024/11/07 01:19:02 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:02 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:02 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:02 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2"
2024/11/07 01:19:02 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_check_access_filters-neqehur0"
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:02 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:02 DEBUG : subdir-not: Making directory with metadata
2024/11/07 01:19:02 INFO  : subdir-not: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdir-not", newDst=subdir-not
2024/11/07 01:19:02 DEBUG : subdirX: Making directory with metadata
2024/11/07 01:19:02 INFO  : subdirX: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdirX", newDst=subdirX
2024/11/07 01:19:02 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1: Making directory with metadata
2024/11/07 01:19:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 INFO  : subdirX/subdirX1: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdirX/subdirX1", newDst=subdirX/subdirX1
2024/11/07 01:19:02 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:02 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:02 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdirX/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdirX/file20.txt.5028a97.partial: renamed to: subdirX/file20.txt
2024/11/07 01:19:02 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:02 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdirX/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdirX/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/RCLONE_TEST.cf9a93ac.partial: renamed to: subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2: Making directory with metadata
2024/11/07 01:19:02 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 INFO  : subdir-not/subdir-not2: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdir-not/subdir-not2", newDst=subdir-not/subdir-not2
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/file30.txt.5028a97.partial: renamed to: subdirX/subdirX1/file30.txt
2024/11/07 01:19:02 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA: Making directory with metadata
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir-not/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdir-not/file20.txt.5028a97.partial: renamed to: subdir-not/file20.txt
2024/11/07 01:19:02 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir-not/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir-not/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:02 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/file30.txt.5028a97.partial: renamed to: subdir-not/subdir-not2/file30.txt
2024/11/07 01:19:02 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:19:02 INFO  : subdir/subdirA: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdir/subdirA", newDst=subdir/subdirA
2024/11/07 01:19:02 DEBUG : subdir/subdirB: Making directory with metadata
2024/11/07 01:19:02 INFO  : subdir/subdirB: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:02 DEBUG : Added delayed dir = "subdir/subdirB", newDst=subdir/subdirB
2024/11/07 01:19:02 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdir/subdirA/file30.txt.5028a97.partial: renamed to: subdir/subdirA/file30.txt
2024/11/07 01:19:02 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir/subdirA/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirA/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_access_filters-neqehur0: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_access_filters-neqehur0: Waiting for transfers to finish
2024/11/07 01:19:02 DEBUG : subdir/subdirB/RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:02 DEBUG : subdir/subdirB/RCLONE_TEST.cf9a93ac.partial: renamed to: subdir/subdirB/RCLONE_TEST
2024/11/07 01:19:02 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : subdir/subdirB/file30.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:02 DEBUG : subdir/subdirB/file30.txt.5028a97.partial: renamed to: subdir/subdirB/file30.txt
2024/11/07 01:19:02 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:19:02 INFO  : subdir/subdirB: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 INFO  : subdirX/subdirX1: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 INFO  : subdir/subdirA: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 INFO  : subdir-not/subdir-not2: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 INFO  : subdirX: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 INFO  : subdir-not: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:02 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_check_access_filters-cavoloj9"
2024/11/07 01:19:02 DEBUG : exclude-other-filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : include-other-filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_access_filters-cavoloj9: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_access_filters-cavoloj9: Waiting for transfers to finish
2024/11/07 01:19:02 DEBUG : exclude-other-filtersfile.txt: md5 = 5fcc6205d7df1c2e9ed3a15a1356b345 OK
2024/11/07 01:19:02 DEBUG : include-other-filtersfile.txt: md5 = 2ec13b2813141ed088e5978ef5a47b0e OK
2024/11/07 01:19:02 DEBUG : include-other-filtersfile.txt.5fb1cd78.partial: renamed to: include-other-filtersfile.txt
2024/11/07 01:19:02 INFO  : include-other-filtersfile.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : exclude-other-filtersfile.txt.9180e6d6.partial: renamed to: exclude-other-filtersfile.txt
2024/11/07 01:19:02 INFO  : exclude-other-filtersfile.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1]
2024/11/07 01:19:02 ERROR : : error listing: directory not found
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2]
2024/11/07 01:19:02 ERROR : : error listing: directory not found
2024/11/07 01:19:02 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_check_access_filters-neqehur0
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1]
2024/11/07 01:19:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/file2.txt]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/file1.txt]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/RCLONE_TEST]
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/file3.txt]
2024/11/07 01:19:02 DEBUG : subdir-not: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not]
2024/11/07 01:19:02 DEBUG : subdirX: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX]
2024/11/07 01:19:02 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1: Making directory
2024/11/07 01:19:02 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/subdirX1]
2024/11/07 01:19:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirA]
2024/11/07 01:19:02 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/subdir-not2]
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirB: Making directory
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirB]
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: Waiting for checks to finish
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: Waiting for transfers to finish
2024/11/07 01:19:02 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/file4.txt]
2024/11/07 01:19:02 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/RCLONE_TEST]
2024/11/07 01:19:02 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/file20.txt]
2024/11/07 01:19:02 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:02 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/file20.txt]
2024/11/07 01:19:03 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/file20.txt]
2024/11/07 01:19:03 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/subdirX1/file30.txt]
2024/11/07 01:19:03 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/subdir-not2/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/subdir-not2/file30.txt]
2024/11/07 01:19:03 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirB/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirB/file30.txt]
2024/11/07 01:19:03 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirA/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirA/file30.txt]
2024/11/07 01:19:03 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:19:03 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/subdirX1]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirB]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/subdirA]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/subdir-not2]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2]
2024/11/07 01:19:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/file2.txt]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/RCLONE_TEST]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/file1.txt]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/file3.txt]
2024/11/07 01:19:03 DEBUG : subdir-not: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not]
2024/11/07 01:19:03 DEBUG : subdirX: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX]
2024/11/07 01:19:03 DEBUG : subdirX/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdirX/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdirX/subdirX1: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX/subdirX1]
2024/11/07 01:19:03 DEBUG : subdir-not/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir-not/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir-not/subdir-not2: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/subdir-not2]
2024/11/07 01:19:03 DEBUG : subdir/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir/subdirA: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirA]
2024/11/07 01:19:03 DEBUG : subdirX/subdirX1/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdirX/subdirX1/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir-not/subdir-not2/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir-not/subdir-not2/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir/subdirB: Making directory
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirB]
2024/11/07 01:19:03 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/file4.txt]
2024/11/07 01:19:03 DEBUG : subdir/subdirB/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir/subdirB/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir/subdirA/RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : subdir/subdirA/file30.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: Waiting for checks to finish
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: Waiting for transfers to finish
2024/11/07 01:19:03 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX/file20.txt]
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/file20.txt]
2024/11/07 01:19:03 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdirX/file20.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/file20.txt]
2024/11/07 01:19:03 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX/subdirX1/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdir-not/file20.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX/subdirX1/file30.txt]
2024/11/07 01:19:03 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/subdir-not2/file30.txt]
2024/11/07 01:19:03 INFO  : subdirX/subdirX1/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirB/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdirX/subdirX1/file30.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirB/file30.txt]
2024/11/07 01:19:03 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirA/RCLONE_TEST]
2024/11/07 01:19:03 INFO  : subdir-not/subdir-not2/file30.txt: Copied (new)
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirA/file30.txt]
2024/11/07 01:19:03 INFO  : subdir/subdirB/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirB/file30.txt: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirA/file30.txt: Copied (new)
2024/11/07 01:19:03 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdirX/subdirX1]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/subdir-not2]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirB]
2024/11/07 01:19:03 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirA]
2024/11/07 01:19:03 NOTICE: (01)  : test check-access-filters
2024/11/07 01:19:03 NOTICE: (02)  : test EXCLUDE - OTHER TESTS
2024/11/07 01:19:03 NOTICE: (03)  : copy-file /tmp/011859lo/datadir/test_check_access_filters-cavoloj9/exclude-other-filtersfile.txt /tmp/011859lo/workdir/
2024/11/07 01:19:03 INFO  : exclude-other-filtersfile.txt: Copied (new)
2024/11/07 01:19:03 NOTICE: (04)  : test resync to get the filters file md5 built.
2024/11/07 01:19:03 NOTICE: (05)  : bisync resync filters-file=/tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:03 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:03 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Using filters file /tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Storing filters file hash to /tmp/011859lo/workdir/exclude-other-filtersfile.txt.md5
2024/11/07 01:19:03 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:03 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:03 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:03 INFO  : Resync updating listings
2024/11/07 01:19:03 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Bisync successful
2024/11/07 01:19:03 NOTICE: (06)  : test EXCLUDE - test filters for check access
2024/11/07 01:19:03 NOTICE: (07)  : bisync check-access filters-file=/tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:03 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:03 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Using filters file /tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:03 INFO  : Path1 checking for diffs
2024/11/07 01:19:03 INFO  : Path2 checking for diffs
2024/11/07 01:19:03 INFO  : Checking access health
2024/11/07 01:19:03 INFO  : Found 3 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:03 INFO  : No changes found
2024/11/07 01:19:03 INFO  : Updating listings
2024/11/07 01:19:03 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Bisync successful
2024/11/07 01:19:03 NOTICE: (08)  : copy-listings exclude-initial
2024/11/07 01:19:03 NOTICE: (09)  : test EXCLUDE - delete RCLONE_TEST files in excluded directories
2024/11/07 01:19:03 NOTICE: (10)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirA/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (11)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (12)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (13)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (14)  : test EXCLUDE - test should PASS
2024/11/07 01:19:03 NOTICE: (15)  : bisync check-access filters-file=/tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:03 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:03 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Using filters file /tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:03 INFO  : Path1 checking for diffs
2024/11/07 01:19:03 INFO  : Path2 checking for diffs
2024/11/07 01:19:03 INFO  : Checking access health
2024/11/07 01:19:03 INFO  : Found 3 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:03 INFO  : No changes found
2024/11/07 01:19:03 INFO  : Updating listings
2024/11/07 01:19:03 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Bisync successful
2024/11/07 01:19:03 NOTICE: (16)  : copy-listings exclude-pass-run
2024/11/07 01:19:03 NOTICE: (17)  : test EXCLUDE - delete RCLONE_TEST files in included directories
2024/11/07 01:19:03 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (20)  : test EXCLUDE - test should ABORT
2024/11/07 01:19:03 NOTICE: (21)  : bisync check-access filters-file=/tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:03 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:03 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Using filters file /tmp/011859lo/workdir/exclude-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:03 INFO  : Path1 checking for diffs
2024/11/07 01:19:03 INFO  : - Path1    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:19:03 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:03 INFO  : Path2 checking for diffs
2024/11/07 01:19:03 INFO  : - Path2    File was deleted          - RCLONE_TEST
2024/11/07 01:19:03 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:03 INFO  : Checking access health
2024/11/07 01:19:03 ERROR : -          Access test failed: Path1 file not found in Path2 - RCLONE_TEST
2024/11/07 01:19:03 ERROR : -          Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST
2024/11/07 01:19:03 ERROR : Bisync critical error: check file check failed
2024/11/07 01:19:03 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:03 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:03 NOTICE: (22)  : move-listings exclude-error-run
2024/11/07 01:19:03 NOTICE: (23)  : test INCLUDE - OTHER TESTS
2024/11/07 01:19:03 NOTICE: (24)  : test reset to the initial state
2024/11/07 01:19:03 NOTICE: (25)  : copy-dir /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_access_filters/initial TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/
2024/11/07 01:19:03 INFO  : subdir-not/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdirX/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 NOTICE: (26)  : sync-dir TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/ TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir-not/subdir-not2/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 INFO  : subdir/subdirA/RCLONE_TEST: Copied (new)
2024/11/07 01:19:03 NOTICE: (27)  : copy-file /tmp/011859lo/datadir/test_check_access_filters-cavoloj9/include-other-filtersfile.txt /tmp/011859lo/workdir/
2024/11/07 01:19:03 INFO  : include-other-filtersfile.txt: Copied (new)
2024/11/07 01:19:03 NOTICE: (28)  : bisync resync filters-file=/tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:03 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:03 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Using filters file /tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Storing filters file hash to /tmp/011859lo/workdir/include-other-filtersfile.txt.md5
2024/11/07 01:19:03 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:03 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:03 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:03 INFO  : Resync updating listings
2024/11/07 01:19:03 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Bisync successful
2024/11/07 01:19:03 NOTICE: (29)  : test INCLUDE - test include/exclude filters for check access
2024/11/07 01:19:03 NOTICE: (30)  : bisync check-access filters-file=/tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:03 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:03 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Using filters file /tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:03 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:03 INFO  : Path1 checking for diffs
2024/11/07 01:19:03 INFO  : Path2 checking for diffs
2024/11/07 01:19:03 INFO  : Checking access health
2024/11/07 01:19:03 INFO  : Found 5 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:03 INFO  : No changes found
2024/11/07 01:19:03 INFO  : Updating listings
2024/11/07 01:19:03 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:03 INFO  : Bisync successful
2024/11/07 01:19:03 NOTICE: (31)  : copy-listings include-initial
2024/11/07 01:19:03 NOTICE: (32)  : test INCLUDE - delete RCLONE_TEST files in excluded directories
2024/11/07 01:19:03 NOTICE: (33)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir/subdirA/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (34)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir-not/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (35)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/subdir-not/subdir-not2/RCLONE_TEST
2024/11/07 01:19:03 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:03 NOTICE: (36)  : test INCLUDE - test should PASS
2024/11/07 01:19:03 NOTICE: (37)  : bisync check-access filters-file=/tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:04 INFO  : Using filters file /tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:04 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:04 INFO  : Path1 checking for diffs
2024/11/07 01:19:04 INFO  : Path2 checking for diffs
2024/11/07 01:19:04 INFO  : Checking access health
2024/11/07 01:19:04 INFO  : Found 5 matching "RCLONE_TEST" files on both paths
2024/11/07 01:19:04 INFO  : No changes found
2024/11/07 01:19:04 INFO  : Updating listings
2024/11/07 01:19:04 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:04 INFO  : Bisync successful
2024/11/07 01:19:04 NOTICE: (38)  : copy-listings include-pass-run
2024/11/07 01:19:04 NOTICE: (39)  : test INCLUDE - delete RCLONE_TEST files in included directories
2024/11/07 01:19:04 NOTICE: (40)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/RCLONE_TEST
2024/11/07 01:19:04 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:04 NOTICE: (41)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdir/RCLONE_TEST
2024/11/07 01:19:04 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:04 NOTICE: (42)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:19:04 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:04 NOTICE: (43)  : test INCLUDE - test should ABORT
2024/11/07 01:19:04 NOTICE: (44)  : bisync check-access filters-file=/tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_access_filters/path2/"
2024/11/07 01:19:04 INFO  : Using filters file /tmp/011859lo/workdir/include-other-filtersfile.txt
2024/11/07 01:19:04 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:04 INFO  : Path1 checking for diffs
2024/11/07 01:19:04 INFO  : - Path1    File was deleted          - subdir/RCLONE_TEST
2024/11/07 01:19:04 INFO  : - Path1    File was deleted          - subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:19:04 INFO  : Path1:    2 changes:    0 new,    0 modified,    2 deleted
2024/11/07 01:19:04 INFO  : Path2 checking for diffs
2024/11/07 01:19:04 INFO  : - Path2    File was deleted          - RCLONE_TEST
2024/11/07 01:19:04 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:04 INFO  : Checking access health
2024/11/07 01:19:04 ERROR : Access test failed: Path1 count 3, Path2 count 4 - RCLONE_TEST
2024/11/07 01:19:04 ERROR : -          Access test failed: Path1 file not found in Path2 - RCLONE_TEST
2024/11/07 01:19:04 ERROR : -          Access test failed: Path2 file not found in Path1 - subdirX/subdirX1/RCLONE_TEST
2024/11/07 01:19:04 ERROR : -          Access test failed: Path2 file not found in Path1 - subdir/RCLONE_TEST
2024/11/07 01:19:04 ERROR : Bisync critical error: check file check failed
2024/11/07 01:19:04 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:04 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:04 NOTICE: (45)  : move-listings include-error-run
    bisync_test.go:558: TEST check_access_filters PASSED
=== RUN   TestBisyncRemoteRemote/check_filename
2024/11/07 01:19:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:04 DEBUG : path1: Making directory
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1"
2024/11/07 01:19:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1"
2024/11/07 01:19:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:04 DEBUG : path2: Making directory
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2"
2024/11/07 01:19:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2"
2024/11/07 01:19:04 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_check_filename-xecizul7"
2024/11/07 01:19:04 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:04 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:04 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:04 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_filename-xecizul7: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:04 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:04 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_filename-xecizul7: Waiting for transfers to finish
2024/11/07 01:19:04 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:04 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:04 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:04 DEBUG : .chk_file.cf9a93ac.partial: renamed to: .chk_file
2024/11/07 01:19:04 INFO  : .chk_file: Copied (new)
2024/11/07 01:19:04 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:04 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:04 DEBUG : subdir/.chk_file.cf9a93ac.partial: renamed to: subdir/.chk_file
2024/11/07 01:19:04 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:19:04 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:04 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_check_filename-fiyezob7"
2024/11/07 01:19:04 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_filename-fiyezob7: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_filename-fiyezob7: Waiting for transfers to finish
2024/11/07 01:19:04 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:19:04 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:19:04 INFO  : hold.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1]
2024/11/07 01:19:04 ERROR : : error listing: directory not found
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2]
2024/11/07 01:19:04 ERROR : : error listing: directory not found
2024/11/07 01:19:04 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_check_filename-xecizul7
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1]
2024/11/07 01:19:04 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : subdir: Making directory
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/subdir]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/.chk_file]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/file1.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/file2.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/file3.txt]
2024/11/07 01:19:04 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: Waiting for transfers to finish
2024/11/07 01:19:04 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/file4.txt]
2024/11/07 01:19:04 INFO  : .chk_file: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/subdir/.chk_file]
2024/11/07 01:19:04 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/subdir/file20.txt]
2024/11/07 01:19:04 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:04 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:19:04 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:04 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/subdir]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2]
2024/11/07 01:19:04 DEBUG : .chk_file: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : subdir: Making directory
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/subdir]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/.chk_file]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/file1.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/file3.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/file2.txt]
2024/11/07 01:19:04 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: Waiting for transfers to finish
2024/11/07 01:19:04 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/file4.txt]
2024/11/07 01:19:04 INFO  : .chk_file: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/subdir/.chk_file]
2024/11/07 01:19:04 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/subdir/file20.txt]
2024/11/07 01:19:04 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:04 INFO  : subdir/.chk_file: Copied (new)
2024/11/07 01:19:04 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:04 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/subdir]
2024/11/07 01:19:04 NOTICE: (01)  : test check-filename
2024/11/07 01:19:04 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:04 NOTICE: (03)  : bisync resync
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:04 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:04 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:04 INFO  : Resync updating listings
2024/11/07 01:19:04 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Bisync successful
2024/11/07 01:19:04 NOTICE: (04)  : test 1. see that check-access passes with the initial setup
2024/11/07 01:19:04 NOTICE: (05)  : bisync check-access check-filename=.chk_file
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:04 INFO  : Path1 checking for diffs
2024/11/07 01:19:04 INFO  : Path2 checking for diffs
2024/11/07 01:19:04 INFO  : Checking access health
2024/11/07 01:19:04 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:19:04 INFO  : No changes found
2024/11/07 01:19:04 INFO  : Updating listings
2024/11/07 01:19:04 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Bisync successful
2024/11/07 01:19:04 NOTICE: (06)  : copy-listings initial-pass
2024/11/07 01:19:04 NOTICE: (07)  : test 2. delete the remote subdir .chk_file, run sync. should fail critical.
2024/11/07 01:19:04 NOTICE: (08)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/subdir/.chk_file
2024/11/07 01:19:04 INFO  : .chk_file: Deleted
2024/11/07 01:19:04 NOTICE: (09)  : bisync check-access check-filename=.chk_file
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:04 INFO  : Path1 checking for diffs
2024/11/07 01:19:04 INFO  : Path2 checking for diffs
2024/11/07 01:19:04 INFO  : - Path2    File was deleted          - subdir/.chk_file
2024/11/07 01:19:04 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:04 INFO  : Checking access health
2024/11/07 01:19:04 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file
2024/11/07 01:19:04 ERROR : -          Access test failed: Path1 file not found in Path2 - subdir/.chk_file
2024/11/07 01:19:04 ERROR : Bisync critical error: check file check failed
2024/11/07 01:19:04 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:04 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:04 NOTICE: (10)  : move-listings path2-missing
2024/11/07 01:19:04 NOTICE: (11)  : test 3. put the remote subdir .chk_file back, run resync.
2024/11/07 01:19:04 NOTICE: (12)  : copy-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/subdir/.chk_file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/subdir/
2024/11/07 01:19:04 INFO  : .chk_file: Copied (new)
2024/11/07 01:19:04 NOTICE: (13)  : bisync check-access resync check-filename=.chk_file
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:04 INFO  : Checking access health
2024/11/07 01:19:04 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:19:04 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:04 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:04 INFO  : Resync updating listings
2024/11/07 01:19:04 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Bisync successful
2024/11/07 01:19:04 NOTICE: (14)  : test 4. run sync with check-access. should pass.
2024/11/07 01:19:04 NOTICE: (15)  : bisync check-access check-filename=.chk_file
2024/11/07 01:19:04 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:04 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:04 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:04 INFO  : Path1 checking for diffs
2024/11/07 01:19:04 INFO  : Path2 checking for diffs
2024/11/07 01:19:04 INFO  : Checking access health
2024/11/07 01:19:04 INFO  : Found 2 matching ".chk_file" files on both paths
2024/11/07 01:19:04 INFO  : No changes found
2024/11/07 01:19:04 INFO  : Updating listings
2024/11/07 01:19:04 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_filename/path2/"
2024/11/07 01:19:04 INFO  : Bisync successful
    bisync_test.go:558: TEST check_filename PASSED
=== RUN   TestBisyncRemoteRemote/check_sync
2024/11/07 01:19:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:04 DEBUG : path1: Making directory
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1"
2024/11/07 01:19:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1"
2024/11/07 01:19:04 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:04 DEBUG : path2: Making directory
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:04 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2"
2024/11/07 01:19:04 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:04 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:04 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:04 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2"
2024/11/07 01:19:04 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_check_sync-xemiyaw3"
2024/11/07 01:19:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:04 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:04 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_sync-xemiyaw3: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:04 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:04 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:04 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/initdir/test_check_sync-xemiyaw3: Waiting for transfers to finish
2024/11/07 01:19:04 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:04 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:04 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:04 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:04 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:04 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:04 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:04 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_check_sync-yucusof4"
2024/11/07 01:19:04 DEBUG : _testdir_path1.._testdir_path2.path1.lst: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : _testdir_path1.._testdir_path2.path2.lst: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : _testdir_path1.._testdir_path2.path1.lst: md5 = fdb18e0dff6961813e12c57227d2e854 OK
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_sync-yucusof4: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : Local file system at /tmp/011859lo/datadir/test_check_sync-yucusof4: Waiting for transfers to finish
2024/11/07 01:19:04 DEBUG : _testdir_path1.._testdir_path2.path1.lst.c670fe74.partial: renamed to: _testdir_path1.._testdir_path2.path1.lst
2024/11/07 01:19:04 INFO  : _testdir_path1.._testdir_path2.path1.lst: Copied (new)
2024/11/07 01:19:04 DEBUG : _testdir_path1.._testdir_path2.path2.lst: md5 = d6ce44a26af9c2110b1750fe88dc4b69 OK
2024/11/07 01:19:04 DEBUG : _testdir_path1.._testdir_path2.path2.lst.c670fe74.partial: renamed to: _testdir_path1.._testdir_path2.path2.lst
2024/11/07 01:19:04 INFO  : _testdir_path1.._testdir_path2.path2.lst: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1]
2024/11/07 01:19:04 ERROR : : error listing: directory not found
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2]
2024/11/07 01:19:04 ERROR : : error listing: directory not found
2024/11/07 01:19:04 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_check_sync-xemiyaw3
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1]
2024/11/07 01:19:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/RCLONE_TEST]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file2.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file1.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: Waiting for transfers to finish
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file3.txt]
2024/11/07 01:19:04 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file4.txt]
2024/11/07 01:19:04 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file5.txt]
2024/11/07 01:19:04 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file6.txt]
2024/11/07 01:19:04 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file7.txt]
2024/11/07 01:19:04 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/file8.txt]
2024/11/07 01:19:04 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:04 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1: list [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path1]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2]
2024/11/07 01:19:04 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/RCLONE_TEST]
2024/11/07 01:19:04 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file1.txt]
2024/11/07 01:19:04 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file2.txt]
2024/11/07 01:19:04 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file3.txt]
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: Waiting for checks to finish
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: Waiting for transfers to finish
2024/11/07 01:19:04 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file4.txt]
2024/11/07 01:19:04 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file5.txt]
2024/11/07 01:19:04 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file6.txt]
2024/11/07 01:19:04 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file7.txt]
2024/11/07 01:19:04 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/file8.txt]
2024/11/07 01:19:04 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:04 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:04 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2
2024/11/07 01:19:04 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2: list [/rclone-test-ruzotid9vaxo/011859lo/check_sync/path2]
2024/11/07 01:19:04 NOTICE: (01)  : test check-sync
2024/11/07 01:19:04 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:04 NOTICE: (03)  : bisync resync
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:05 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:05 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:05 INFO  : Resync updating listings
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Bisync successful
2024/11/07 01:19:05 NOTICE: (04)  : test 1. run check-sync-only on a clean sync
2024/11/07 01:19:05 NOTICE: (05)  : bisync check-sync-only
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Bisync successful
2024/11/07 01:19:05 NOTICE: (06)  : test 2. inject modified listings into the workdir
2024/11/07 01:19:05 NOTICE: (07)  : copy-as /tmp/011859lo/datadir/test_check_sync-yucusof4/_testdir_path1.._testdir_path2.path1.lst /tmp/011859lo/workdir/ TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path1.lst
2024/11/07 01:19:05 INFO  : _testdir_path1.._testdir_path2.path1.lst: Copied (replaced existing) to: TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path1.lst
2024/11/07 01:19:05 NOTICE: (08)  : copy-as /tmp/011859lo/datadir/test_check_sync-yucusof4/_testdir_path1.._testdir_path2.path2.lst /tmp/011859lo/workdir/ TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path2.lst
2024/11/07 01:19:05 INFO  : _testdir_path1.._testdir_path2.path2.lst: Copied (replaced existing) to: TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path2.lst
2024/11/07 01:19:05 NOTICE: (09)  : test 3. run check-sync-only on modified listings
2024/11/07 01:19:05 NOTICE: (10)  : bisync check-sync-only
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 ERROR : -          Path1 file not found in Path2      - file2.txt
2024/11/07 01:19:05 ERROR : -          Path2 file not found in Path1      - file1.txt
2024/11/07 01:19:05 ERROR : Bisync critical error: path1 and path2 are out of sync, run --resync to recover
2024/11/07 01:19:05 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:05 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:05 NOTICE: (11)  : copy-listings check-sync-only
2024/11/07 01:19:05 NOTICE: (12)  : test 4. run normal sync to check that it aborts
2024/11/07 01:19:05 NOTICE: (13)  : bisync
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path1.lst
Path2: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011859lo/workdir"
2024/11/07 01:19:05 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:05 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:05 NOTICE: (14)  : test 5. prune failure listings after critical abort
2024/11/07 01:19:05 NOTICE: (15)  : delete-glob /tmp/011859lo/workdir/ *.lst
2024/11/07 01:19:05 NOTICE: (16)  : delete-glob /tmp/011859lo/workdir/ *.lst-err
2024/11/07 01:19:05 INFO  : TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path1.lst-err: Deleted
2024/11/07 01:19:05 INFO  : TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path2.lst-err: Deleted
2024/11/07 01:19:05 NOTICE: (17)  : delete-glob /tmp/011859lo/workdir/ *.lst-new
2024/11/07 01:19:05 INFO  : TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path1.lst-new: Deleted
2024/11/07 01:19:05 INFO  : TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_check_sync_path2.path2.lst-new: Deleted
2024/11/07 01:19:05 NOTICE: (18)  : test 6. run resync
2024/11/07 01:19:05 NOTICE: (19)  : bisync resync
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:05 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:05 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:05 INFO  : Resync updating listings
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Bisync successful
2024/11/07 01:19:05 NOTICE: (20)  : test 7. run normal sync with check-sync enabled (default)
2024/11/07 01:19:05 NOTICE: (21)  : bisync
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:05 INFO  : Path1 checking for diffs
2024/11/07 01:19:05 INFO  : Path2 checking for diffs
2024/11/07 01:19:05 INFO  : No changes found
2024/11/07 01:19:05 INFO  : Updating listings
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Bisync successful
2024/11/07 01:19:05 NOTICE: (22)  : test 8. run normal sync with no-check-sync
2024/11/07 01:19:05 NOTICE: (23)  : bisync no-check-sync
2024/11/07 01:19:05 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/check_sync/path2/"
2024/11/07 01:19:05 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:05 INFO  : Path1 checking for diffs
2024/11/07 01:19:05 INFO  : Path2 checking for diffs
2024/11/07 01:19:05 INFO  : No changes found
2024/11/07 01:19:05 INFO  : Updating listings
2024/11/07 01:19:05 INFO  : Bisync successful
    bisync_test.go:558: TEST check_sync PASSED
=== RUN   TestBisyncRemoteRemote/compare_all
2024/11/07 01:19:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:05 DEBUG : path1: Making directory
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1"
2024/11/07 01:19:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1"
2024/11/07 01:19:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:05 DEBUG : path2: Making directory
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2"
2024/11/07 01:19:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2"
2024/11/07 01:19:05 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_compare_all-kiteyam3"
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:05 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/initdir/test_compare_all-kiteyam3: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/initdir/test_compare_all-kiteyam3: Waiting for transfers to finish
2024/11/07 01:19:05 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:05 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:05 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:05 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:05 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:05 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:05 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:05 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:05 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:05 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:05 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_compare_all-ditanev1"
2024/11/07 01:19:05 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/datadir/test_compare_all-ditanev1: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/datadir/test_compare_all-ditanev1: Waiting for transfers to finish
2024/11/07 01:19:05 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:05 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:19:05 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:19:05 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:19:05 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:05 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:05 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:19:05 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:05 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:19:05 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:19:05 INFO  : file5L.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:19:05 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:19:05 INFO  : file5R.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:05 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:05 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:19:05 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:19:05 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: list [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1]
2024/11/07 01:19:05 ERROR : : error listing: directory not found
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: list [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2]
2024/11/07 01:19:05 ERROR : : error listing: directory not found
2024/11/07 01:19:05 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_compare_all-kiteyam3
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: list [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1]
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: Waiting for transfers to finish
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/RCLONE_TEST]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file1.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file2.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file3.txt]
2024/11/07 01:19:05 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file4.txt]
2024/11/07 01:19:05 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file5.txt]
2024/11/07 01:19:05 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file6.txt]
2024/11/07 01:19:05 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file7.txt]
2024/11/07 01:19:05 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file8.txt]
2024/11/07 01:19:05 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:05 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1: list [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path1]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: list [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2]
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file1.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/RCLONE_TEST]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file3.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file2.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: Waiting for transfers to finish
2024/11/07 01:19:05 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file4.txt]
2024/11/07 01:19:05 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file5.txt]
2024/11/07 01:19:05 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file6.txt]
2024/11/07 01:19:05 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file7.txt]
2024/11/07 01:19:05 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: update [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file8.txt]
2024/11/07 01:19:05 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:05 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2: list [/rclone-test-ruzotid9vaxo/011859lo/compare_all/path2]
2024/11/07 01:19:05 NOTICE: (01)  : test changes compare-all
2024/11/07 01:19:05 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:05 NOTICE: (03)  : bisync resync compare-all
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/"
2024/11/07 01:19:05 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:05 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:05 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:05 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:05 INFO  : Resync updating listings
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/"
2024/11/07 01:19:05 INFO  : Bisync successful
2024/11/07 01:19:05 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:19:05 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:19:05 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/
2024/11/07 01:19:05 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:05 NOTICE: (07)  : test newer on path2 - file1
2024/11/07 01:19:05 NOTICE: (08)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/
2024/11/07 01:19:05 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:05 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:19:05 NOTICE: (10)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/
2024/11/07 01:19:05 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:05 NOTICE: (11)  : test newer on path1 - file2
2024/11/07 01:19:05 NOTICE: (12)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/
2024/11/07 01:19:05 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:05 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:19:05 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file3.txt
2024/11/07 01:19:05 INFO  : file3.txt: Deleted
2024/11/07 01:19:05 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:19:05 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file4.txt
2024/11/07 01:19:05 INFO  : file4.txt: Deleted
2024/11/07 01:19:05 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:19:05 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file8.txt
2024/11/07 01:19:05 INFO  : file8.txt: Deleted
2024/11/07 01:19:05 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file8.txt
2024/11/07 01:19:05 INFO  : file8.txt: Deleted
2024/11/07 01:19:05 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:19:05 NOTICE: (21)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/ file5R.txt
2024/11/07 01:19:05 NOTICE: (22)  : copy-as /tmp/011859lo/datadir/test_compare_all-ditanev1/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/ file5.txt
2024/11/07 01:19:05 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:05 NOTICE: (23)  : touch-glob 2001-03-04 /tmp/011859lo/datadir/test_compare_all-ditanev1/ file5L.txt
2024/11/07 01:19:05 NOTICE: (24)  : copy-as /tmp/011859lo/datadir/test_compare_all-ditanev1/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/ file5.txt
2024/11/07 01:19:05 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:05 NOTICE: (25)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:19:05 NOTICE: (26)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/
2024/11/07 01:19:05 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:19:05 NOTICE: (27)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file6.txt
2024/11/07 01:19:05 INFO  : file6.txt: Deleted
2024/11/07 01:19:05 NOTICE: (28)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:19:05 NOTICE: (29)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_compare_all-ditanev1/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/
2024/11/07 01:19:05 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:19:05 NOTICE: (30)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file7.txt
2024/11/07 01:19:05 INFO  : file7.txt: Deleted
2024/11/07 01:19:05 NOTICE: (31)  : test bisync run
2024/11/07 01:19:05 NOTICE: (32)  : bisync compare-all
2024/11/07 01:19:05 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:05 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/"
2024/11/07 01:19:05 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:05 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:05 INFO  : Path1 checking for diffs
2024/11/07 01:19:05 INFO  : - Path1    File changed: size (larger), time (newer), hash - file2.txt
2024/11/07 01:19:05 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:19:05 INFO  : - Path1    File changed: size (larger), time (newer), hash - file5.txt
2024/11/07 01:19:05 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:19:05 INFO  : - Path1    File changed: size (larger), time (newer), hash - file7.txt
2024/11/07 01:19:05 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:19:05 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:19:05 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:19:05 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:19:05 INFO  : Path2 checking for diffs
2024/11/07 01:19:05 INFO  : - Path2    File changed: size (larger), time (newer), hash - file1.txt
2024/11/07 01:19:05 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:19:05 INFO  : - Path2    File changed: size (larger), time (newer), hash - file5.txt
2024/11/07 01:19:05 INFO  : - Path2    File changed: size (larger), time (newer), hash - file6.txt
2024/11/07 01:19:05 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:19:05 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:19:05 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:19:05 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:19:05 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:19:05 INFO  : Applying changes
2024/11/07 01:19:05 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file11.txt
2024/11/07 01:19:05 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file2.txt
2024/11/07 01:19:05 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file4.txt
2024/11/07 01:19:05 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:19:05 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file5.txt.conflict1
2024/11/07 01:19:05 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:19:05 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file5.txt.conflict1
2024/11/07 01:19:05 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file5.txt.conflict2
2024/11/07 01:19:05 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:19:05 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file5.txt.conflict2
2024/11/07 01:19:05 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file6.txt
2024/11/07 01:19:05 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/file7.txt
2024/11/07 01:19:05 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file1.txt
2024/11/07 01:19:05 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file10.txt
2024/11/07 01:19:05 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/file3.txt
2024/11/07 01:19:05 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:05 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:19:05 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:05 INFO  : file3.txt: Deleted
2024/11/07 01:19:05 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:05 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:19:05 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:05 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:05 INFO  : file4.txt: Deleted
2024/11/07 01:19:05 INFO  : Updating listings
2024/11/07 01:19:05 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/compare_all/path2/"
2024/11/07 01:19:05 INFO  : Bisync successful
    bisync_test.go:558: TEST compare_all PASSED
=== RUN   TestBisyncRemoteRemote/createemptysrcdirs
2024/11/07 01:19:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:05 DEBUG : path1: Making directory
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1"
2024/11/07 01:19:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1"
2024/11/07 01:19:05 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:05 DEBUG : path2: Making directory
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:05 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2"
2024/11/07 01:19:05 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:05 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:05 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:05 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2"
2024/11/07 01:19:05 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_createemptysrcdirs-bonacaq1"
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:19:05 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/initdir/test_createemptysrcdirs-bonacaq1: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/initdir/test_createemptysrcdirs-bonacaq1: Waiting for transfers to finish
2024/11/07 01:19:05 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:19:05 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:19:05 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:19:05 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:19:05 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:05 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:05 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:05 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:05 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6"
2024/11/07 01:19:05 DEBUG : placeholder.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : Local file system at /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6: Waiting for transfers to finish
2024/11/07 01:19:05 DEBUG : placeholder.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:05 DEBUG : placeholder.txt.4db661ca.partial: renamed to: placeholder.txt
2024/11/07 01:19:05 INFO  : placeholder.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1]
2024/11/07 01:19:05 ERROR : : error listing: directory not found
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2]
2024/11/07 01:19:05 ERROR : : error listing: directory not found
2024/11/07 01:19:05 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_createemptysrcdirs-bonacaq1
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1]
2024/11/07 01:19:05 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/RCLONE_TEST]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/file1.copy1.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/file1.copy2.txt]
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: Waiting for checks to finish
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: Waiting for transfers to finish
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/file1.copy3.txt]
2024/11/07 01:19:05 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/file1.copy4.txt]
2024/11/07 01:19:05 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:05 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/file1.copy5.txt]
2024/11/07 01:19:06 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/file1.txt]
2024/11/07 01:19:06 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:06 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2]
2024/11/07 01:19:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: Waiting for checks to finish
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/RCLONE_TEST]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: Waiting for transfers to finish
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/file1.copy1.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/file1.copy3.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/file1.copy2.txt]
2024/11/07 01:19:06 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/file1.copy4.txt]
2024/11/07 01:19:06 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/file1.copy5.txt]
2024/11/07 01:19:06 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/file1.txt]
2024/11/07 01:19:06 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:06 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2]
2024/11/07 01:19:06 NOTICE: (01)  : test createemptysrcdirs
2024/11/07 01:19:06 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:06 NOTICE: (03)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/ placeholder.txt
2024/11/07 01:19:06 NOTICE: (04)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:06 NOTICE: (05)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy1.txt
2024/11/07 01:19:06 NOTICE: (06)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy2.txt
2024/11/07 01:19:06 NOTICE: (07)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy3.txt
2024/11/07 01:19:06 NOTICE: (08)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy4.txt
2024/11/07 01:19:06 NOTICE: (09)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (replaced existing) to: file1.copy5.txt
2024/11/07 01:19:06 NOTICE: (10)  : bisync resync
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:06 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:06 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:06 INFO  : file1.copy2.txt: Copied (replaced existing)
2024/11/07 01:19:06 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:06 INFO  : file1.copy1.txt: Copied (replaced existing)
2024/11/07 01:19:06 INFO  : file1.copy3.txt: Copied (replaced existing)
2024/11/07 01:19:06 INFO  : file1.copy4.txt: Copied (replaced existing)
2024/11/07 01:19:06 INFO  : file1.copy5.txt: Copied (replaced existing)
2024/11/07 01:19:06 INFO  : Resync updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
2024/11/07 01:19:06 NOTICE: (11)  : test 1. Create an empty dir on Path1 by creating subdir/placeholder.txt and then deleting the placeholder
2024/11/07 01:19:06 NOTICE: (12)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ subdir/placeholder.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: subdir/placeholder.txt
2024/11/07 01:19:06 NOTICE: (13)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ subdir
2024/11/07 01:19:06 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/subdir/placeholder.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Deleted
2024/11/07 01:19:06 NOTICE: (15)  : test 2. Run bisync without --create-empty-src-dirs
2024/11/07 01:19:06 NOTICE: (16)  : bisync
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:06 INFO  : Path1 checking for diffs
2024/11/07 01:19:06 INFO  : Path2 checking for diffs
2024/11/07 01:19:06 INFO  : No changes found
2024/11/07 01:19:06 INFO  : Updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
2024/11/07 01:19:06 NOTICE: (17)  : test 3. Confirm the subdir exists only on Path1 and not Path2
2024/11/07 01:19:06 NOTICE: (18)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (19)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/
2024/11/07 01:19:06 NOTICE: (20)  : test 4.Run bisync WITH --create-empty-src-dirs
2024/11/07 01:19:06 NOTICE: (21)  : bisync create-empty-src-dirs
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:06 INFO  : Path1 checking for diffs
2024/11/07 01:19:06 INFO  : - Path1    File is new               - subdir
2024/11/07 01:19:06 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:06 INFO  : Path2 checking for diffs
2024/11/07 01:19:06 INFO  : Applying changes
2024/11/07 01:19:06 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/subdir
2024/11/07 01:19:06 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:06 INFO  : Updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
2024/11/07 01:19:06 NOTICE: (22)  : test 5. Confirm the subdir exists on both paths
2024/11/07 01:19:06 NOTICE: (23)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (24)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (25)  : test 6. Delete the empty dir on Path1 using purge-children (and also add files so the path isn't empty)
2024/11/07 01:19:06 NOTICE: (26)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: (27)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.txt
2024/11/07 01:19:06 NOTICE: (28)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy1.txt
2024/11/07 01:19:06 NOTICE: (29)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy2.txt
2024/11/07 01:19:06 NOTICE: (30)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy3.txt
2024/11/07 01:19:06 NOTICE: (31)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy4.txt
2024/11/07 01:19:06 NOTICE: (32)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy5.txt
2024/11/07 01:19:06 NOTICE: (33)  : test 7. Run bisync without --create-empty-src-dirs
2024/11/07 01:19:06 NOTICE: (34)  : bisync
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:06 INFO  : Path1 checking for diffs
2024/11/07 01:19:06 INFO  : - Path1    File was deleted          - RCLONE_TEST
2024/11/07 01:19:06 INFO  : - Path1    File was deleted          - subdir
2024/11/07 01:19:06 INFO  : Path1:    2 changes:    0 new,    0 modified,    2 deleted
2024/11/07 01:19:06 INFO  : Path2 checking for diffs
2024/11/07 01:19:06 INFO  : - Path2    File was deleted          - subdir
2024/11/07 01:19:06 INFO  : Path2:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:06 INFO  : Applying changes
2024/11/07 01:19:06 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/RCLONE_TEST
2024/11/07 01:19:06 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:06 INFO  : RCLONE_TEST: Deleted
2024/11/07 01:19:06 INFO  : Updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
2024/11/07 01:19:06 NOTICE: (35)  : test 8. Confirm the subdir exists only on Path2 and not Path1
2024/11/07 01:19:06 NOTICE: (36)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: (37)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (38)  : test 9. Reset, do the delete again, and run bisync WITH --create-empty-src-dirs
2024/11/07 01:19:06 NOTICE: (39)  : bisync resync create-empty-src-dirs
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:06 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:06 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:06 INFO  : Resync updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
2024/11/07 01:19:06 NOTICE: (40)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (41)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (42)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: (43)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.txt
2024/11/07 01:19:06 NOTICE: (44)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy1.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy1.txt
2024/11/07 01:19:06 NOTICE: (45)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy2.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy2.txt
2024/11/07 01:19:06 NOTICE: (46)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy3.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy3.txt
2024/11/07 01:19:06 NOTICE: (47)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy4.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy4.txt
2024/11/07 01:19:06 NOTICE: (48)  : copy-as /tmp/011859lo/datadir/test_createemptysrcdirs-jutepok6/placeholder.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/ file1.copy5.txt
2024/11/07 01:19:06 INFO  : placeholder.txt: Copied (new) to: file1.copy5.txt
2024/11/07 01:19:06 NOTICE: (49)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: (50)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/
2024/11/07 01:19:06 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:06 NOTICE: (51)  : bisync create-empty-src-dirs
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:06 INFO  : Path1 checking for diffs
2024/11/07 01:19:06 INFO  : - Path1    File was deleted          - subdir
2024/11/07 01:19:06 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:06 INFO  : Path2 checking for diffs
2024/11/07 01:19:06 INFO  : Applying changes
2024/11/07 01:19:06 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/subdir
2024/11/07 01:19:06 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:06 INFO  : subdir: Removing directory
2024/11/07 01:19:06 INFO  : Updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
2024/11/07 01:19:06 NOTICE: (52)  : test 10. Confirm the subdir has been removed on both paths
2024/11/07 01:19:06 NOTICE: (53)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/
2024/11/07 01:19:06 NOTICE: (54)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/
2024/11/07 01:19:06 NOTICE: (55)  : test 11. bisync again (because if we leave subdir in listings, test will fail due to mismatched modtime)
2024/11/07 01:19:06 NOTICE: (56)  : bisync create-empty-src-dirs
2024/11/07 01:19:06 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:06 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:06 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:06 INFO  : Path1 checking for diffs
2024/11/07 01:19:06 INFO  : Path2 checking for diffs
2024/11/07 01:19:06 INFO  : No changes found
2024/11/07 01:19:06 INFO  : Updating listings
2024/11/07 01:19:06 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/createemptysrcdirs/path2/"
2024/11/07 01:19:06 INFO  : Bisync successful
    bisync_test.go:558: TEST createemptysrcdirs PASSED
=== RUN   TestBisyncRemoteRemote/dry_run
2024/11/07 01:19:06 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:06 DEBUG : path1: Making directory
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:06 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1"
2024/11/07 01:19:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:06 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1"
2024/11/07 01:19:06 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:06 DEBUG : path2: Making directory
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:06 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2"
2024/11/07 01:19:06 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:06 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:06 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:06 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:06 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2"
2024/11/07 01:19:06 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_dry_run-qiweqef6"
2024/11/07 01:19:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:06 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : Local file system at /tmp/011859lo/initdir/test_dry_run-qiweqef6: Waiting for checks to finish
2024/11/07 01:19:06 DEBUG : Local file system at /tmp/011859lo/initdir/test_dry_run-qiweqef6: Waiting for transfers to finish
2024/11/07 01:19:06 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:06 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:06 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:06 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:06 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:06 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:06 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:06 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:06 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:06 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:06 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_dry_run-dibugub7"
2024/11/07 01:19:06 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : Local file system at /tmp/011859lo/datadir/test_dry_run-dibugub7: Waiting for checks to finish
2024/11/07 01:19:06 DEBUG : Local file system at /tmp/011859lo/datadir/test_dry_run-dibugub7: Waiting for transfers to finish
2024/11/07 01:19:06 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:06 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:06 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:06 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:19:06 DEBUG : file10.txt.925c801f.partial: renamed to: file10.txt
2024/11/07 01:19:06 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file2.txt.f8ac1735.partial: renamed to: file2.txt
2024/11/07 01:19:06 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:06 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file11.txt.925c801f.partial: renamed to: file11.txt
2024/11/07 01:19:06 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:19:06 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:19:06 INFO  : file5L.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:06 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:06 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:19:06 DEBUG : file7.txt.925c801f.partial: renamed to: file7.txt
2024/11/07 01:19:06 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:19:06 DEBUG : file6.txt.925c801f.partial: renamed to: file6.txt
2024/11/07 01:19:06 INFO  : file5R.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: list [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1]
2024/11/07 01:19:06 ERROR : : error listing: directory not found
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: list [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2]
2024/11/07 01:19:06 ERROR : : error listing: directory not found
2024/11/07 01:19:06 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_dry_run-qiweqef6
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: list [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1]
2024/11/07 01:19:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file1.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/RCLONE_TEST]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file2.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: Waiting for checks to finish
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file3.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: Waiting for transfers to finish
2024/11/07 01:19:06 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file4.txt]
2024/11/07 01:19:06 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file5.txt]
2024/11/07 01:19:06 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file6.txt]
2024/11/07 01:19:06 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file7.txt]
2024/11/07 01:19:06 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:06 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:06 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1: list [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path1]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: list [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2]
2024/11/07 01:19:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/RCLONE_TEST]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file1.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file2.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file3.txt]
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: Waiting for checks to finish
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: Waiting for transfers to finish
2024/11/07 01:19:06 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file4.txt]
2024/11/07 01:19:06 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file5.txt]
2024/11/07 01:19:06 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file6.txt]
2024/11/07 01:19:06 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:06 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: update [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file7.txt]
2024/11/07 01:19:06 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:06 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:07 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: list [/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2]
2024/11/07 01:19:07 NOTICE: (01)  : test dry-run
2024/11/07 01:19:07 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:07 NOTICE: (03)  : bisync resync
2024/11/07 01:19:07 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:07 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:07 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/"
2024/11/07 01:19:07 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:07 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:07 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:07 INFO  : Resync updating listings
2024/11/07 01:19:07 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/"
2024/11/07 01:19:07 INFO  : Bisync successful
2024/11/07 01:19:07 NOTICE: (04)  : test new on path2 - file10
2024/11/07 01:19:07 NOTICE: (05)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/
2024/11/07 01:19:07 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:07 NOTICE: (06)  : test newer on path2 - file1
2024/11/07 01:19:07 NOTICE: (07)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/
2024/11/07 01:19:07 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:07 NOTICE: (08)  : test new on path1 - file11
2024/11/07 01:19:07 NOTICE: (09)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/
2024/11/07 01:19:07 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:07 NOTICE: (10)  : test newer on path1 - file2
2024/11/07 01:19:07 NOTICE: (11)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/
2024/11/07 01:19:07 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:07 NOTICE: (12)  : test deleted on path2 - file3
2024/11/07 01:19:07 NOTICE: (13)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file3.txt
2024/11/07 01:19:07 INFO  : file3.txt: Deleted
2024/11/07 01:19:07 NOTICE: (14)  : test deleted on path1 - file4
2024/11/07 01:19:07 NOTICE: (15)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file4.txt
2024/11/07 01:19:07 INFO  : file4.txt: Deleted
2024/11/07 01:19:07 NOTICE: (16)  : test changed on path2 and on path1 - file5 (file5R, file5L)
2024/11/07 01:19:07 NOTICE: (17)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/ file5R.txt
2024/11/07 01:19:07 NOTICE: (18)  : copy-as /tmp/011859lo/datadir/test_dry_run-dibugub7/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/ file5.txt
2024/11/07 01:19:07 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:07 NOTICE: (19)  : touch-glob 2001-03-04 /tmp/011859lo/datadir/test_dry_run-dibugub7/ file5L.txt
2024/11/07 01:19:07 NOTICE: (20)  : copy-as /tmp/011859lo/datadir/test_dry_run-dibugub7/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/ file5.txt
2024/11/07 01:19:07 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:07 NOTICE: (21)  : test newer on path2 and deleted on path1 - file6
2024/11/07 01:19:07 NOTICE: (22)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/
2024/11/07 01:19:07 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:19:07 NOTICE: (23)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file6.txt
2024/11/07 01:19:07 INFO  : file6.txt: Deleted
2024/11/07 01:19:07 NOTICE: (24)  : test newer on path1 and deleted on path2 - file7
2024/11/07 01:19:07 NOTICE: (25)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_dry_run-dibugub7/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/
2024/11/07 01:19:07 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:19:07 NOTICE: (26)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file7.txt
2024/11/07 01:19:07 INFO  : file7.txt: Deleted
2024/11/07 01:19:07 NOTICE: (27)  : test sync with dry-run and resync
2024/11/07 01:19:07 NOTICE: (28)  : bisync dry-run resync
2024/11/07 01:19:07 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:07 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:07 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/"
2024/11/07 01:19:07 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:07 NOTICE: - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:07 NOTICE: file4.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:19:07 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:07 NOTICE: file3.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:19:07 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file5.txt: Skipped copy as --dry-run is set (size 39)
2024/11/07 01:19:07 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 0)
2024/11/07 01:19:07 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13)
2024/11/07 01:19:07 INFO  : Resync updating listings
2024/11/07 01:19:07 INFO  : Bisync successful
2024/11/07 01:19:07 NOTICE: (29)  : copy-listings dryrun-resync
2024/11/07 01:19:07 NOTICE: (30)  : test sync with dry-run
2024/11/07 01:19:07 NOTICE: (31)  : bisync dry-run
2024/11/07 01:19:07 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:07 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:07 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/"
2024/11/07 01:19:07 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:07 INFO  : Path1 checking for diffs
2024/11/07 01:19:07 NOTICE: - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:07 NOTICE: - Path1    File was deleted          - file4.txt
2024/11/07 01:19:07 NOTICE: - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:19:07 NOTICE: - Path1    File was deleted          - file6.txt
2024/11/07 01:19:07 NOTICE: - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:19:07 NOTICE: - Path1    File is new               - file11.txt
2024/11/07 01:19:07 INFO  : Path1:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:19:07 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:19:07 INFO  : Path2 checking for diffs
2024/11/07 01:19:07 NOTICE: - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:07 NOTICE: - Path2    File was deleted          - file3.txt
2024/11/07 01:19:07 NOTICE: - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:19:07 NOTICE: - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:19:07 NOTICE: - Path2    File was deleted          - file7.txt
2024/11/07 01:19:07 NOTICE: - Path2    File is new               - file10.txt
2024/11/07 01:19:07 INFO  : Path2:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:19:07 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:19:07 INFO  : Applying changes
2024/11/07 01:19:07 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:07 INFO  : Checking potential conflicts...
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: 1 differences found
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: 1 errors while checking
2024/11/07 01:19:07 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:07 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file11.txt
2024/11/07 01:19:07 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file2.txt
2024/11/07 01:19:07 NOTICE: - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file4.txt
2024/11/07 01:19:07 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:19:07 NOTICE: file5.txt: Skipped rename as --dry-run is set
2024/11/07 01:19:07 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file5.txt.conflict1
2024/11/07 01:19:07 NOTICE: file5.txt: Skipped rename as --dry-run is set
2024/11/07 01:19:07 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file5.txt.conflict2
2024/11/07 01:19:07 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file6.txt
2024/11/07 01:19:07 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file7.txt
2024/11/07 01:19:07 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file1.txt
2024/11/07 01:19:07 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file10.txt
2024/11/07 01:19:07 NOTICE: - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file3.txt
2024/11/07 01:19:07 NOTICE: - Path2    Do queued copies to                - Path1
2024/11/07 01:19:07 NOTICE: file10.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file6.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file1.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file3.txt: Skipped delete as --dry-run is set (size 0)
2024/11/07 01:19:07 NOTICE: - Path1    Do queued copies to                - Path2
2024/11/07 01:19:07 NOTICE: file11.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file7.txt: Skipped copy as --dry-run is set (size 19)
2024/11/07 01:19:07 NOTICE: file2.txt: Skipped copy as --dry-run is set (size 13)
2024/11/07 01:19:07 NOTICE: file4.txt: Skipped delete as --dry-run is set (size 0)
2024/11/07 01:19:07 INFO  : Updating listings
2024/11/07 01:19:07 INFO  : Bisync successful
2024/11/07 01:19:07 NOTICE: (32)  : copy-listings dryrun
2024/11/07 01:19:07 NOTICE: (33)  : test sync without dry-run
2024/11/07 01:19:07 NOTICE: (34)  : bisync
2024/11/07 01:19:07 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:07 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:07 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/"
2024/11/07 01:19:07 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:07 INFO  : Path1 checking for diffs
2024/11/07 01:19:07 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:07 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:19:07 INFO  : - Path1    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:19:07 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:19:07 INFO  : - Path1    File changed: size (larger), time (newer) - file7.txt
2024/11/07 01:19:07 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:19:07 INFO  : Path1:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:19:07 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:19:07 INFO  : Path2 checking for diffs
2024/11/07 01:19:07 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:07 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:19:07 INFO  : - Path2    File changed: size (larger), time (newer) - file5.txt
2024/11/07 01:19:07 INFO  : - Path2    File changed: size (larger), time (newer) - file6.txt
2024/11/07 01:19:07 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:19:07 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:19:07 INFO  : Path2:    6 changes:    1 new,    3 modified,    2 deleted
2024/11/07 01:19:07 INFO  : (Modified:    3 newer,    0 older,    3 larger,    0 smaller)
2024/11/07 01:19:07 INFO  : Applying changes
2024/11/07 01:19:07 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:07 INFO  : Checking potential conflicts...
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: 1 differences found
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/dry_run/path2: 1 errors while checking
2024/11/07 01:19:07 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:07 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file11.txt
2024/11/07 01:19:07 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file2.txt
2024/11/07 01:19:07 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file4.txt
2024/11/07 01:19:07 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:19:07 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file5.txt.conflict1
2024/11/07 01:19:07 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:19:07 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file5.txt.conflict1
2024/11/07 01:19:07 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file5.txt.conflict2
2024/11/07 01:19:07 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:19:07 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file5.txt.conflict2
2024/11/07 01:19:07 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file6.txt
2024/11/07 01:19:07 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/file7.txt
2024/11/07 01:19:07 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file1.txt
2024/11/07 01:19:07 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file10.txt
2024/11/07 01:19:07 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/file3.txt
2024/11/07 01:19:07 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:07 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:07 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:19:07 INFO  : file3.txt: Deleted
2024/11/07 01:19:07 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:07 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:19:07 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:07 INFO  : file4.txt: Deleted
2024/11/07 01:19:07 INFO  : Updating listings
2024/11/07 01:19:07 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/dry_run/path2/"
2024/11/07 01:19:07 INFO  : Bisync successful
    bisync_test.go:558: TEST dry_run PASSED
=== RUN   TestBisyncRemoteRemote/equal
2024/11/07 01:19:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:07 DEBUG : path1: Making directory
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/equal/path1"
2024/11/07 01:19:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/equal/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1"
2024/11/07 01:19:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:07 DEBUG : path2: Making directory
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/equal/path2"
2024/11/07 01:19:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/equal/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2"
2024/11/07 01:19:07 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_equal-bujoxac8"
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/initdir/test_equal-bujoxac8: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/initdir/test_equal-bujoxac8: Waiting for transfers to finish
2024/11/07 01:19:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:07 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:07 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:07 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:07 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:07 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_equal-faluced7"
2024/11/07 01:19:07 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/datadir/test_equal-faluced7: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/datadir/test_equal-faluced7: Waiting for transfers to finish
2024/11/07 01:19:07 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:19:07 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:19:07 DEBUG : file1L.txt.a9dc541c.partial: renamed to: file1L.txt
2024/11/07 01:19:07 INFO  : file1L.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK
2024/11/07 01:19:07 DEBUG : file2.txt.fbf6b964.partial: renamed to: file2.txt
2024/11/07 01:19:07 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : file1R.txt.c0691a20.partial: renamed to: file1R.txt
2024/11/07 01:19:07 INFO  : file1R.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: list [/rclone-test-ruzotid9vaxo/011859lo/equal/path1]
2024/11/07 01:19:07 ERROR : : error listing: directory not found
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: list [/rclone-test-ruzotid9vaxo/011859lo/equal/path2]
2024/11/07 01:19:07 ERROR : : error listing: directory not found
2024/11/07 01:19:07 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_equal-bujoxac8
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: list [/rclone-test-ruzotid9vaxo/011859lo/equal/path1]
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: Waiting for transfers to finish
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: update [/rclone-test-ruzotid9vaxo/011859lo/equal/path1/file1.txt]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: update [/rclone-test-ruzotid9vaxo/011859lo/equal/path1/RCLONE_TEST]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: update [/rclone-test-ruzotid9vaxo/011859lo/equal/path1/file2.txt]
2024/11/07 01:19:07 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:07 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:07 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:07 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path1: list [/rclone-test-ruzotid9vaxo/011859lo/equal/path1]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: list [/rclone-test-ruzotid9vaxo/011859lo/equal/path2]
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: update [/rclone-test-ruzotid9vaxo/011859lo/equal/path2/RCLONE_TEST]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: Waiting for transfers to finish
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: update [/rclone-test-ruzotid9vaxo/011859lo/equal/path2/file1.txt]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: update [/rclone-test-ruzotid9vaxo/011859lo/equal/path2/file2.txt]
2024/11/07 01:19:07 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:07 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:07 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:07 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: list [/rclone-test-ruzotid9vaxo/011859lo/equal/path2]
2024/11/07 01:19:07 NOTICE: (01)  : test equal
2024/11/07 01:19:07 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:07 NOTICE: (03)  : bisync resync
2024/11/07 01:19:07 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:07 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:07 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2/"
2024/11/07 01:19:07 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:07 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:07 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:07 INFO  : Resync updating listings
2024/11/07 01:19:07 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2/"
2024/11/07 01:19:07 INFO  : Bisync successful
2024/11/07 01:19:07 NOTICE: (04)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:07 NOTICE: (05)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_equal-faluced7/ file1R.txt
2024/11/07 01:19:07 NOTICE: (06)  : copy-as /tmp/011859lo/datadir/test_equal-faluced7/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/equal/path2/ file1.txt
2024/11/07 01:19:07 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:07 NOTICE: (07)  : touch-glob 2001-03-04 /tmp/011859lo/datadir/test_equal-faluced7/ file1L.txt
2024/11/07 01:19:07 NOTICE: (08)  : copy-as /tmp/011859lo/datadir/test_equal-faluced7/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/equal/path1/ file1.txt
2024/11/07 01:19:07 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:07 NOTICE: (09)  : test changed on both paths and identical - file2
2024/11/07 01:19:07 NOTICE: (10)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_equal-faluced7/ file2.txt
2024/11/07 01:19:07 NOTICE: (11)  : copy-as /tmp/011859lo/datadir/test_equal-faluced7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/equal/path1/ file2.txt
2024/11/07 01:19:07 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:07 NOTICE: (12)  : copy-as /tmp/011859lo/datadir/test_equal-faluced7/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/equal/path2/ file2.txt
2024/11/07 01:19:07 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:07 NOTICE: (13)  : test bisync run
2024/11/07 01:19:07 NOTICE: (14)  : bisync
2024/11/07 01:19:07 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:07 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:07 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2/"
2024/11/07 01:19:07 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:07 INFO  : Path1 checking for diffs
2024/11/07 01:19:07 INFO  : - Path1    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:07 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:07 INFO  : Path1:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:19:07 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:19:07 INFO  : Path2 checking for diffs
2024/11/07 01:19:07 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:07 INFO  : - Path2    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:07 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:19:07 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:19:07 INFO  : Applying changes
2024/11/07 01:19:07 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:07 INFO  : Checking potential conflicts...
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: 1 differences found
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: 1 errors while checking
2024/11/07 01:19:07 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/equal/path2: 1 matching files
2024/11/07 01:19:07 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:07 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:07 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1/file1.txt.conflict1
2024/11/07 01:19:07 INFO  : file1.txt: Moved (server-side) to: file1.txt.conflict1
2024/11/07 01:19:07 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2/file1.txt.conflict1
2024/11/07 01:19:07 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2/file1.txt.conflict2
2024/11/07 01:19:07 INFO  : file1.txt: Moved (server-side) to: file1.txt.conflict2
2024/11/07 01:19:07 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1/file1.txt.conflict2
2024/11/07 01:19:07 NOTICE: - WARNING  New or changed in both paths       - file2.txt
2024/11/07 01:19:07 INFO  : Files are equal! Skipping: file2.txt
2024/11/07 01:19:07 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:07 INFO  : file1.txt.conflict2: Copied (new)
2024/11/07 01:19:07 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:07 INFO  : file1.txt.conflict1: Copied (new)
2024/11/07 01:19:07 INFO  : Updating listings
2024/11/07 01:19:07 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:07 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:07 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/equal/path2/"
2024/11/07 01:19:07 INFO  : Bisync successful
    bisync_test.go:558: TEST equal PASSED
=== RUN   TestBisyncRemoteRemote/ext_paths
2024/11/07 01:19:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:07 DEBUG : path1: Making directory
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1"
2024/11/07 01:19:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1"
2024/11/07 01:19:07 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:07 DEBUG : path2: Making directory
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:07 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2"
2024/11/07 01:19:07 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:07 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:07 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:07 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2"
2024/11/07 01:19:07 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_ext_paths-nequxiy6"
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ: Making directory with metadata
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ: Made directory with metadata (mtime=2024-04-17T01:00:03.064427195Z)
2024/11/07 01:19:07 DEBUG : Added delayed dir = "測試Ру��кий  ěáñ", newDst=測試Ру��кий  ěáñ
2024/11/07 01:19:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:07 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:19:07 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/initdir/test_ext_paths-nequxiy6: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/initdir/test_ext_paths-nequxiy6: Waiting for transfers to finish
2024/11/07 01:19:07 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:19:07 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:07 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:07 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:19:07 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:19:07 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:07 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : 測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:07 DEBUG : 測試_check file.5028a97.partial: renamed to: 測試_check file
2024/11/07 01:19:07 INFO  : 測試_check file: Copied (new)
2024/11/07 01:19:07 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:07 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/測試_check file.5028a97.partial: renamed to: 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ě_.txt
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ: Set directory modification time (using SetModTime)
2024/11/07 01:19:07 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_ext_paths-cabivem8"
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/datadir/test_ext_paths-cabivem8: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : Local file system at /tmp/011859lo/datadir/test_ext_paths-cabivem8: Waiting for transfers to finish
2024/11/07 01:19:07 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:07 DEBUG : file1.txt.917a74a1.partial: renamed to: file1.txt
2024/11/07 01:19:07 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:19:07 DEBUG : 測試_filtersfile.txt.1c47c956.partial: renamed to: 測試_filtersfile.txt
2024/11/07 01:19:07 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1]
2024/11/07 01:19:07 ERROR : : error listing: directory not found
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2]
2024/11/07 01:19:07 ERROR : : error listing: directory not found
2024/11/07 01:19:07 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_ext_paths-nequxiy6
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1]
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ: Making directory
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/RCLONE_TEST]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/file1.txt]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/file_enconde_mañana_funcionará.txt]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/filename_contains_ě_.txt]
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: Waiting for transfers to finish
2024/11/07 01:19:07 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/filename_contains_ࢺ_.txt]
2024/11/07 01:19:07 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/Ру��кий.txt]
2024/11/07 01:19:07 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試_check file]
2024/11/07 01:19:07 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/filename_contains_ě_.txt]
2024/11/07 01:19:07 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt]
2024/11/07 01:19:07 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/測試_check file]
2024/11/07 01:19:07 INFO  : 測試_check file: Copied (new)
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:07 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:19:07 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2]
2024/11/07 01:19:07 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/RCLONE_TEST]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/file1.txt]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/filename_contains_ě_.txt]
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/file_enconde_mañana_funcionará.txt]
2024/11/07 01:19:07 DEBUG : 測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ: Making directory
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ]
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : 測試Ру��кий  ěáñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: Waiting for checks to finish
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: Waiting for transfers to finish
2024/11/07 01:19:07 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:07 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/filename_contains_ࢺ_.txt]
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/Ру��кий.txt]
2024/11/07 01:19:08 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試_check file]
2024/11/07 01:19:08 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/filename_contains_ě_.txt]
2024/11/07 01:19:08 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt]
2024/11/07 01:19:08 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/測試_check file]
2024/11/07 01:19:08 INFO  : 測試_check file: Copied (new)
2024/11/07 01:19:08 INFO  : 測試Ру��кий  ěáñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 INFO  : 測試Ру��кий  ěáñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:19:08 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ]
2024/11/07 01:19:08 NOTICE: (01)  : test extended-char-paths
2024/11/07 01:19:08 NOTICE: (02)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/
2024/11/07 01:19:08 ERROR : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-rijiraq0: Server side directory move failed: rename /rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěa�ñ: file does not exist
2024/11/07 01:19:08 INFO  : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists
2024/11/07 01:19:08 ERROR : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ-rclone-move-rijiraq0: error reading source root directory: directory not found
2024/11/07 01:19:08 NOTICE: (03)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/
2024/11/07 01:19:08 ERROR : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-qacakoy5: Server side directory move failed: rename /rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěa�ñ: file does not exist
2024/11/07 01:19:08 INFO  : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/: Server side directory move failed - fallback to file moves: can't copy directory - destination already exists
2024/11/07 01:19:08 ERROR : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ-rclone-move-qacakoy5: error reading source root directory: directory not found
2024/11/07 01:19:08 NOTICE: (04)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:19:08 NOTICE: (05)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:19:08 NOTICE: (06)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/filename_contains_ě_.txt
2024/11/07 01:19:08 NOTICE: (07)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/filename_contains_ě_.txt
2024/11/07 01:19:08 NOTICE: (08)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試_check{spc}file
2024/11/07 01:19:08 NOTICE: (09)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試_check{spc}file
2024/11/07 01:19:08 NOTICE: (10)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:19:08 NOTICE: (11)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:19:08 NOTICE: (12)  : test resync subdirs with extended chars
2024/11/07 01:19:08 NOTICE: (13)  : bisync subdir=測試Ру��кий{spc}{spc}ěáñ resync
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:19:08 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:08 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:08 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:08 INFO  : Resync updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:19:08 INFO  : Bisync successful
2024/11/07 01:19:08 NOTICE: (14)  : copy-listings resync
2024/11/07 01:19:08 NOTICE: (15)  : test place new files with extended chars on each side
2024/11/07 01:19:08 NOTICE: (16)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_ext_paths-cabivem8/ file1.txt
2024/11/07 01:19:08 NOTICE: (17)  : copy-as /tmp/011859lo/datadir/test_ext_paths-cabivem8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ 測試_file1p1
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new) to: 測試_file1p1
2024/11/07 01:19:08 NOTICE: (18)  : copy-as /tmp/011859lo/datadir/test_ext_paths-cabivem8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий{spc}{spc}ěáñ 測試_file1p2
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new) to: 測試_file1p2
2024/11/07 01:19:08 NOTICE: (19)  : test normal sync of subdirs with extended chars
2024/11/07 01:19:08 NOTICE: (20)  : bisync subdir=測試Ру��кий{spc}{spc}ěáñ
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:19:08 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:08 INFO  : Path1 checking for diffs
2024/11/07 01:19:08 INFO  : - Path1    File is new               - 測試_file1p1
2024/11/07 01:19:08 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:08 INFO  : Path2 checking for diffs
2024/11/07 01:19:08 INFO  : - Path2    File is new               - 測試_file1p2
2024/11/07 01:19:08 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:08 INFO  : Applying changes
2024/11/07 01:19:08 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/測試_file1p1
2024/11/07 01:19:08 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/測試_file1p2
2024/11/07 01:19:08 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:08 INFO  : 測試_file1p2: Copied (new)
2024/11/07 01:19:08 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:08 INFO  : 測試_file1p1: Copied (new)
2024/11/07 01:19:08 INFO  : Updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий  ěáñ/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/測試Ру��кий  ěáñ/"
2024/11/07 01:19:08 INFO  : Bisync successful
2024/11/07 01:19:08 NOTICE: (21)  : move-listings normal-sync
2024/11/07 01:19:08 NOTICE: (22)  : test check-filename with extended chars. check should fail.
2024/11/07 01:19:08 NOTICE: (23)  : bisync resync
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:08 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:08 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:08 INFO  : Resync updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Bisync successful
2024/11/07 01:19:08 NOTICE: (24)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/測試Ру��кий{spc}{spc}ěáñ/測試_check{spc}file
2024/11/07 01:19:08 INFO  : 測試_check file: Deleted
2024/11/07 01:19:08 NOTICE: (25)  : bisync check-access check-filename=測試_check{spc}file
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:08 INFO  : Path1 checking for diffs
2024/11/07 01:19:08 INFO  : - Path1    File was deleted          - 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:19:08 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:08 INFO  : Path2 checking for diffs
2024/11/07 01:19:08 INFO  : Checking access health
2024/11/07 01:19:08 ERROR : Access test failed: Path1 count 1, Path2 count 2 - 測試_check file
2024/11/07 01:19:08 ERROR : -          Access test failed: Path2 file not found in Path1 - 測試Ру��кий  ěáñ/測試_check file
2024/11/07 01:19:08 ERROR : Bisync critical error: check file check failed
2024/11/07 01:19:08 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:08 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:08 NOTICE: (26)  : copy-listings check-access-fail
2024/11/07 01:19:08 NOTICE: (27)  : test check-filename with extended chars. check should pass.
2024/11/07 01:19:08 NOTICE: (28)  : bisync resync
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:08 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:08 INFO  : 測試Ру��кий  ěáñ/測試_check file: Copied (new)
2024/11/07 01:19:08 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:08 INFO  : Resync updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Bisync successful
2024/11/07 01:19:08 NOTICE: (29)  : bisync check-access check-filename=測試_check{spc}file
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:08 INFO  : Path1 checking for diffs
2024/11/07 01:19:08 INFO  : Path2 checking for diffs
2024/11/07 01:19:08 INFO  : Checking access health
2024/11/07 01:19:08 INFO  : Found 2 matching "測試_check file" files on both paths
2024/11/07 01:19:08 INFO  : No changes found
2024/11/07 01:19:08 INFO  : Updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Bisync successful
2024/11/07 01:19:08 NOTICE: (30)  : move-listings check-access-pass
2024/11/07 01:19:08 NOTICE: (31)  : test filters-file path with extended chars - masks /fileZ.txt
2024/11/07 01:19:08 NOTICE: (32)  : copy-file /tmp/011859lo/datadir/test_ext_paths-cabivem8/測試_filtersfile.txt /tmp/011859lo/workdir/
2024/11/07 01:19:08 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:19:08 NOTICE: (33)  : bisync filters-file=/tmp/011859lo/workdir/測試_filtersfile.txt resync
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Using filters file /tmp/011859lo/workdir/測試_filtersfile.txt
2024/11/07 01:19:08 INFO  : Storing filters file hash to /tmp/011859lo/workdir/測試_filtersfile.txt.md5
2024/11/07 01:19:08 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:08 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:08 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:08 INFO  : Resync updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Bisync successful
2024/11/07 01:19:08 NOTICE: (34)  : copy-as /tmp/011859lo/datadir/test_ext_paths-cabivem8/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/ fileZ.txt
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new) to: fileZ.txt
2024/11/07 01:19:08 NOTICE: (35)  : bisync filters-file=/tmp/011859lo/workdir/測試_filtersfile.txt
2024/11/07 01:19:08 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:08 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:08 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Using filters file /tmp/011859lo/workdir/測試_filtersfile.txt
2024/11/07 01:19:08 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:08 INFO  : Path1 checking for diffs
2024/11/07 01:19:08 INFO  : Path2 checking for diffs
2024/11/07 01:19:08 INFO  : No changes found
2024/11/07 01:19:08 INFO  : Updating listings
2024/11/07 01:19:08 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ext_paths/path2/"
2024/11/07 01:19:08 INFO  : Bisync successful
    bisync_test.go:558: TEST ext_paths PASSED
=== RUN   TestBisyncRemoteRemote/extended_filenames
2024/11/07 01:19:08 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:08 DEBUG : path1: Making directory
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:08 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1"
2024/11/07 01:19:08 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:08 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:08 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1"
2024/11/07 01:19:08 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:08 DEBUG : path2: Making directory
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:08 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2"
2024/11/07 01:19:08 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:08 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:08 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:08 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:08 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2"
2024/11/07 01:19:08 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_extended_filenames-xihoros3"
2024/11/07 01:19:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:08 DEBUG : file1 - Copy (2).txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:08 DEBUG : file1 - Copy.txt.5028a97.partial: renamed to: file1 - Copy.txt
2024/11/07 01:19:08 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy (2).txt.5028a97.partial: renamed to: file1 - Copy (2).txt
2024/11/07 01:19:08 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:19:08 DEBUG : file_enconde_mañana_funcionará.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:08 DEBUG : file_enconde_mañana_funcionará.txt.5028a97.partial: renamed to: file_enconde_mañana_funcionará.txt
2024/11/07 01:19:08 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_: Making directory with metadata
2024/11/07 01:19:08 INFO  : subdir_with_ࢺ_: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:08 DEBUG : Added delayed dir = "subdir_with_ࢺ_", newDst=subdir_with_ࢺ_
2024/11/07 01:19:08 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:08 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : Local file system at /tmp/011859lo/initdir/test_extended_filenames-xihoros3: Waiting for checks to finish
2024/11/07 01:19:08 DEBUG : Local file system at /tmp/011859lo/initdir/test_extended_filenames-xihoros3: Waiting for transfers to finish
2024/11/07 01:19:08 DEBUG : Ру��кий.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:08 DEBUG : filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:08 DEBUG : Ру��кий.txt.5028a97.partial: renamed to: Ру��кий.txt
2024/11/07 01:19:08 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: filename_contains_ࢺ_.txt
2024/11/07 01:19:08 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:08 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:08 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:19:08 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: subdir_with_ࢺ_/filename_contains_ࢺ_.txt
2024/11/07 01:19:08 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:08 DEBUG : filename_contains_ě_.txt.480f4fd7.partial: renamed to: filename_contains_ě_.txt
2024/11/07 01:19:08 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 INFO  : subdir_with_ࢺ_: Set directory modification time (using SetModTime)
2024/11/07 01:19:08 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_extended_filenames-jonuwax1"
2024/11/07 01:19:08 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : Local file system at /tmp/011859lo/datadir/test_extended_filenames-jonuwax1: Waiting for checks to finish
2024/11/07 01:19:08 DEBUG : Local file system at /tmp/011859lo/datadir/test_extended_filenames-jonuwax1: Waiting for transfers to finish
2024/11/07 01:19:08 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:08 DEBUG : file1.txt.f73bbb59.partial: renamed to: file1.txt
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : file2.txt: md5 = 40b811fb5009223b6da573f169619d8e OK
2024/11/07 01:19:08 DEBUG : file2.txt.761be064.partial: renamed to: file2.txt
2024/11/07 01:19:08 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1]
2024/11/07 01:19:08 ERROR : : error listing: directory not found
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2]
2024/11/07 01:19:08 ERROR : : error listing: directory not found
2024/11/07 01:19:08 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_extended_filenames-xihoros3
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1]
2024/11/07 01:19:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_: Making directory
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/RCLONE_TEST]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/file1 - Copy.txt]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/file1 - Copy (2).txt]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/file1.txt]
2024/11/07 01:19:08 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: Waiting for checks to finish
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: Waiting for transfers to finish
2024/11/07 01:19:08 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/file_enconde_mañana_funcionará.txt]
2024/11/07 01:19:08 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/filename_contains_ě_.txt]
2024/11/07 01:19:08 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/filename_contains_ࢺ_.txt]
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/Ру��кий.txt]
2024/11/07 01:19:08 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ě_.txt]
2024/11/07 01:19:08 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_.txt]
2024/11/07 01:19:08 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:08 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2]
2024/11/07 01:19:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy (2).txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1 - Copy.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : file_enconde_mañana_funcionará.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_: Making directory
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/RCLONE_TEST]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/file1 - Copy (2).txt]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/file1.txt]
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/file1 - Copy.txt]
2024/11/07 01:19:08 DEBUG : Ру��кий.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: Waiting for checks to finish
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: Waiting for transfers to finish
2024/11/07 01:19:08 INFO  : file1 - Copy (2).txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/file_enconde_mañana_funcionará.txt]
2024/11/07 01:19:08 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/filename_contains_ě_.txt]
2024/11/07 01:19:08 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/filename_contains_ࢺ_.txt]
2024/11/07 01:19:08 INFO  : file1 - Copy.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/Ру��кий.txt]
2024/11/07 01:19:08 INFO  : file_enconde_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt]
2024/11/07 01:19:08 INFO  : filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: update [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ࢺ_.txt]
2024/11/07 01:19:08 INFO  : filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:08 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:08 DEBUG : pacer: low level retry 1/10 (error create /rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt: replication in progress)
2024/11/07 01:19:08 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2024/11/07 01:19:09 DEBUG : pacer: Reducing sleep to 30ms
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : pacer: Reducing sleep to 22.5ms
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:09 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2: list [/rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_]
2024/11/07 01:19:09 NOTICE: (01)  : test extended-filenames
2024/11/07 01:19:09 NOTICE: (02)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/
2024/11/07 01:19:09 NOTICE: (03)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/
2024/11/07 01:19:09 NOTICE: (04)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:19:09 NOTICE: (05)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:19:09 NOTICE: (06)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/Ру��кий.txt
2024/11/07 01:19:09 NOTICE: (07)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/Ру��кий.txt
2024/11/07 01:19:09 NOTICE: (08)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/file_enconde_mañana_funcionará.txt
2024/11/07 01:19:09 NOTICE: (09)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/file_enconde_mañana_funcionará.txt
2024/11/07 01:19:09 NOTICE: (10)  : test initial bisync
2024/11/07 01:19:09 NOTICE: (11)  : bisync resync
2024/11/07 01:19:09 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:09 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:09 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:09 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:09 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/"
2024/11/07 01:19:09 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:09 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:09 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:09 INFO  : Resync updating listings
2024/11/07 01:19:09 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/"
2024/11/07 01:19:09 INFO  : Bisync successful
2024/11/07 01:19:09 NOTICE: (12)  : test place a newer files on both paths
2024/11/07 01:19:09 NOTICE: (13)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/ file1.txt
2024/11/07 01:19:09 NOTICE: (14)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/ file2.txt
2024/11/07 01:19:09 NOTICE: (15)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/ New_top_level_mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: New_top_level_mañana_funcionará.txt
2024/11/07 01:19:09 NOTICE: (16)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/ file_enconde_mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (replaced existing) to: file_enconde_mañana_funcionará.txt
2024/11/07 01:19:09 NOTICE: (17)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/ filename_contains_ࢺ_p1m.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: filename_contains_ࢺ_p1m.txt
2024/11/07 01:19:09 NOTICE: (18)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/ Ру��кий.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (replaced existing) to: Ру��кий.txt
2024/11/07 01:19:09 NOTICE: (19)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/ file1_with{spc}white{spc}space.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: file1_with white space.txt
2024/11/07 01:19:09 NOTICE: (20)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_ test.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: test.txt
2024/11/07 01:19:09 NOTICE: (21)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_ mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: mañana_funcionará.txt
2024/11/07 01:19:09 NOTICE: (22)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_ file_with_測試_.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: file_with_測試_.txt
2024/11/07 01:19:09 NOTICE: (23)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_ filename_contains_ࢺ_p2s.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: filename_contains_ࢺ_p2s.txt
2024/11/07 01:19:09 NOTICE: (24)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir{spc}with{eol}white{spc}space.txt file2{spc}with{eol}white{spc}space.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: file2 with
white space.txt
2024/11/07 01:19:09 NOTICE: (25)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_rawchars_{chr:19}_{chr:81}_{chr:fe} file3_{chr:19}_{chr:81}_{chr:fe}
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: file3__�_þ
2024/11/07 01:19:09 NOTICE: (26)  : fix-names TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir{spc}with{eol}white{spc}space.txt/file2{spc}with{eol}white{spc}space.txt
2024/11/07 01:19:09 NOTICE: (27)  : test place a new file on both paths
2024/11/07 01:19:09 NOTICE: (28)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_ filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 INFO  : file2.txt: Copied (new) to: filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 NOTICE: (29)  : touch-glob 2001-01-03 /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/ file1.txt
2024/11/07 01:19:09 NOTICE: (30)  : copy-as /tmp/011859lo/datadir/test_extended_filenames-jonuwax1/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_ filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new) to: filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 NOTICE: (31)  : test delete files on both paths
2024/11/07 01:19:09 NOTICE: (32)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/filename_contains_ࢺ_.txt
2024/11/07 01:19:09 INFO  : filename_contains_ࢺ_.txt: Deleted
2024/11/07 01:19:09 NOTICE: (33)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:19:09 INFO  : filename_contains_ě_.txt: Deleted
2024/11/07 01:19:09 NOTICE: (34)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/Ру��кий.txt
2024/11/07 01:19:09 INFO  : Ру��кий.txt: Deleted
2024/11/07 01:19:09 NOTICE: (35)  : test bisync run
2024/11/07 01:19:09 NOTICE: (36)  : bisync
2024/11/07 01:19:09 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:09 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:09 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:09 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:09 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/"
2024/11/07 01:19:09 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:09 INFO  : Path1 checking for diffs
2024/11/07 01:19:09 INFO  : - Path1    File was deleted          - Ру��кий.txt
2024/11/07 01:19:09 INFO  : - Path1    File is new               - file1_with white space.txt
2024/11/07 01:19:09 INFO  : - Path1    File is new               - filename_contains_ࢺ_p1m.txt
2024/11/07 01:19:09 INFO  : - Path1    File is new               - subdir_with_ࢺ_/file_with_測試_.txt
2024/11/07 01:19:09 INFO  : - Path1    File is new               - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 INFO  : - Path1    File is new               - subdir_with_ࢺ_/mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : - Path1    File is new               - subdir_with_ࢺ_/test.txt
2024/11/07 01:19:09 INFO  : Path1:    7 changes:    6 new,    0 modified,    1 deleted
2024/11/07 01:19:09 INFO  : Path2 checking for diffs
2024/11/07 01:19:09 INFO  : - Path2    File changed: size (larger), time (newer) - file_enconde_mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : - Path2    File was deleted          - filename_contains_ࢺ_.txt
2024/11/07 01:19:09 INFO  : - Path2    File was deleted          - subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:19:09 INFO  : - Path2    File changed: size (larger), time (newer) - Ру��кий.txt
2024/11/07 01:19:09 INFO  : - Path2    File is new               - New_top_level_mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : - Path2    File is new               - subdir with�white space.txt/file2 with�white space.txt
2024/11/07 01:19:09 INFO  : - Path2    File is new               - "subdir_rawchars_�_\x81_\xfe/file3_�_\x81_\xfe"
2024/11/07 01:19:09 INFO  : - Path2    File is new               - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 INFO  : - Path2    File is new               - subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt
2024/11/07 01:19:09 INFO  : Path2:    9 changes:    5 new,    2 modified,    2 deleted
2024/11/07 01:19:09 INFO  : (Modified:    2 newer,    0 older,    2 larger,    0 smaller)
2024/11/07 01:19:09 INFO  : Applying changes
2024/11/07 01:19:09 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/file1_with white space.txt
2024/11/07 01:19:09 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/filename_contains_ࢺ_p1m.txt
2024/11/07 01:19:09 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/file_with_測試_.txt
2024/11/07 01:19:09 NOTICE: - WARNING  New or changed in both paths       - subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt
2024/11/07 01:19:09 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt: Moved (server-side) to: subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1
2024/11/07 01:19:09 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1
2024/11/07 01:19:09 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt: Moved (server-side) to: subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2
2024/11/07 01:19:09 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2
2024/11/07 01:19:09 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/subdir_with_ࢺ_/test.txt
2024/11/07 01:19:09 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/Ру��кий.txt
2024/11/07 01:19:09 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/New_top_level_mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/file_enconde_mañana_funcionará.txt
2024/11/07 01:19:09 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/filename_contains_ࢺ_.txt
2024/11/07 01:19:09 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir with�white space.txt/file2 with�white space.txt
2024/11/07 01:19:09 INFO  : - Path2    Queue copy to Path1       - "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_rawchars_�_\x81_\xfe/file3_�_\x81_\xfe"
2024/11/07 01:19:09 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ě_.txt
2024/11/07 01:19:09 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt
2024/11/07 01:19:09 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:09 INFO  : New_top_level_mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:09 INFO  : Ру��кий.txt: Copied (new)
2024/11/07 01:19:09 INFO  : file_enconde_mañana_funcionará.txt: Copied (replaced existing)
2024/11/07 01:19:09 INFO  : subdir with�white space.txt/file2 with�white space.txt: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict2: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filename_contains_ࢺ_p2s.txt: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_rawchars_â�™_�_þ/file3_â�™_�_þ: Copied (new)
2024/11/07 01:19:09 INFO  : filename_contains_ࢺ_.txt: Deleted
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filename_contains_ě_.txt: Deleted
2024/11/07 01:19:09 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:09 INFO  : file1_with white space.txt: Copied (new)
2024/11/07 01:19:09 INFO  : filename_contains_ࢺ_p1m.txt: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/file_with_測試_.txt: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/filechangedbothpaths_ࢺ_.txt.conflict1: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/mañana_funcionará.txt: Copied (new)
2024/11/07 01:19:09 INFO  : subdir_with_ࢺ_/test.txt: Copied (new)
2024/11/07 01:19:09 INFO  : Updating listings
2024/11/07 01:19:09 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/extended_filenames/path2/"
2024/11/07 01:19:09 INFO  : Bisync successful
    bisync_test.go:558: TEST extended_filenames PASSED
=== RUN   TestBisyncRemoteRemote/filters
2024/11/07 01:19:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:09 DEBUG : path1: Making directory
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filters/path1"
2024/11/07 01:19:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filters/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path1"
2024/11/07 01:19:09 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:09 DEBUG : path2: Making directory
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:09 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filters/path2"
2024/11/07 01:19:09 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:09 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:09 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:09 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:09 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filters/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path2"
2024/11/07 01:19:09 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_filters-peqizec6"
2024/11/07 01:19:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:09 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:09 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : Local file system at /tmp/011859lo/initdir/test_filters-peqizec6: Waiting for checks to finish
2024/11/07 01:19:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : Local file system at /tmp/011859lo/initdir/test_filters-peqizec6: Waiting for transfers to finish
2024/11/07 01:19:09 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:09 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:09 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:09 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:09 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:09 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:09 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:09 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:09 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:09 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:09 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:09 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:09 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_filters-wotoquq3"
2024/11/07 01:19:09 DEBUG : fileZ.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : Local file system at /tmp/011859lo/datadir/test_filters-wotoquq3: Waiting for checks to finish
2024/11/07 01:19:09 DEBUG : Local file system at /tmp/011859lo/datadir/test_filters-wotoquq3: Waiting for transfers to finish
2024/11/07 01:19:09 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:09 DEBUG : fileZ.txt.925c801f.partial: renamed to: fileZ.txt
2024/11/07 01:19:09 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:19:09 DEBUG : filtersfile.flt.9f8671d3.partial: renamed to: filtersfile.flt
2024/11/07 01:19:09 INFO  : filtersfile.flt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path1]
2024/11/07 01:19:09 ERROR : : error listing: directory not found
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path2]
2024/11/07 01:19:09 ERROR : : error listing: directory not found
2024/11/07 01:19:09 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_filters-peqizec6
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path1]
2024/11/07 01:19:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : subdir: Making directory
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/subdir]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/RCLONE_TEST]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file2.txt]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file1.txt]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file3.txt]
2024/11/07 01:19:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: Waiting for checks to finish
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: Waiting for transfers to finish
2024/11/07 01:19:09 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file4.txt]
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file5.txt]
2024/11/07 01:19:09 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file6.txt]
2024/11/07 01:19:09 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/file7.txt]
2024/11/07 01:19:09 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/subdir/file20.txt]
2024/11/07 01:19:09 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:09 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:09 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:09 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:09 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path1]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path1/subdir]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path2]
2024/11/07 01:19:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file1.txt]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/RCLONE_TEST]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file2.txt]
2024/11/07 01:19:09 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : subdir: Making directory
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/subdir]
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file3.txt]
2024/11/07 01:19:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: Waiting for checks to finish
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: Waiting for transfers to finish
2024/11/07 01:19:09 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file4.txt]
2024/11/07 01:19:09 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file5.txt]
2024/11/07 01:19:09 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:09 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file6.txt]
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/file7.txt]
2024/11/07 01:19:10 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/subdir/file20.txt]
2024/11/07 01:19:10 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path2]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filters/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filters/path2/subdir]
2024/11/07 01:19:10 NOTICE: (01)  : test filters
2024/11/07 01:19:10 NOTICE: (02)  : copy-file /tmp/011859lo/datadir/test_filters-wotoquq3/filtersfile.flt /tmp/011859lo/workdir/
2024/11/07 01:19:10 INFO  : filtersfile.flt: Copied (new)
2024/11/07 01:19:10 NOTICE: (03)  : test resync to force building of the filters md5 hash
2024/11/07 01:19:10 NOTICE: (04)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.flt resync
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.flt
2024/11/07 01:19:10 INFO  : Storing filters file hash to /tmp/011859lo/workdir/filtersfile.flt.md5
2024/11/07 01:19:10 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:10 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:10 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:10 INFO  : Resync updating listings
2024/11/07 01:19:10 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path2/"
2024/11/07 01:19:10 INFO  : Bisync successful
2024/11/07 01:19:10 NOTICE: (05)  : copy-listings resync
2024/11/07 01:19:10 NOTICE: (06)  : test place new files on the remote
2024/11/07 01:19:10 NOTICE: (07)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_filters-wotoquq3/ fileZ.txt
2024/11/07 01:19:10 NOTICE: (08)  : copy-as /tmp/011859lo/datadir/test_filters-wotoquq3/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/filters/path2/ fileZ.txt
2024/11/07 01:19:10 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:19:10 NOTICE: (09)  : copy-as /tmp/011859lo/datadir/test_filters-wotoquq3/fileZ.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/filters/path1/subdir fileZ.txt
2024/11/07 01:19:10 INFO  : fileZ.txt: Copied (new)
2024/11/07 01:19:10 NOTICE: (10)  : test bisync with filters-file. path2-side fileZ.txt will be filtered.
2024/11/07 01:19:10 NOTICE: (11)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.flt
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.flt
2024/11/07 01:19:10 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:10 INFO  : Path1 checking for diffs
2024/11/07 01:19:10 INFO  : - Path1    File is new               - subdir/fileZ.txt
2024/11/07 01:19:10 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:10 INFO  : Path2 checking for diffs
2024/11/07 01:19:10 INFO  : Applying changes
2024/11/07 01:19:10 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path2/subdir/fileZ.txt
2024/11/07 01:19:10 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:10 INFO  : subdir/fileZ.txt: Copied (new)
2024/11/07 01:19:10 INFO  : Updating listings
2024/11/07 01:19:10 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filters/path2/"
2024/11/07 01:19:10 INFO  : Bisync successful
    bisync_test.go:558: TEST filters PASSED
=== RUN   TestBisyncRemoteRemote/filtersfile_checks
2024/11/07 01:19:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:10 DEBUG : path1: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1"
2024/11/07 01:19:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1"
2024/11/07 01:19:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:10 DEBUG : path2: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2"
2024/11/07 01:19:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2"
2024/11/07 01:19:10 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_filtersfile_checks-xiferoh7"
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:10 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:10 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:10 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:10 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/initdir/test_filtersfile_checks-xiferoh7: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/initdir/test_filtersfile_checks-xiferoh7: Waiting for transfers to finish
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:10 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_filtersfile_checks-vogigad6"
2024/11/07 01:19:10 DEBUG : filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : filtersfile2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/datadir/test_filtersfile_checks-vogigad6: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : filtersfile2.txt: md5 = 95acc1e3b5beda465d9b2cb32808588c OK
2024/11/07 01:19:10 DEBUG : filtersfile.txt: md5 = cbf4389cb34d9e160689d1578eb5707f OK
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/datadir/test_filtersfile_checks-vogigad6: Waiting for transfers to finish
2024/11/07 01:19:10 DEBUG : filtersfile2.txt.9f8671d3.partial: renamed to: filtersfile2.txt
2024/11/07 01:19:10 INFO  : filtersfile2.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:19:10 DEBUG : filtersfile.txt.f1af69b0.partial: renamed to: filtersfile.txt
2024/11/07 01:19:10 INFO  : filtersfile.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:19:10 INFO  : hold.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1]
2024/11/07 01:19:10 ERROR : : error listing: directory not found
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2]
2024/11/07 01:19:10 ERROR : : error listing: directory not found
2024/11/07 01:19:10 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_filtersfile_checks-xiferoh7
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1]
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : subdir: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/subdir]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/RCLONE_TEST]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/file1.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/file2.txt]
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/subdir/file20.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: Waiting for transfers to finish
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/subdir]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2]
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : subdir: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/subdir]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/RCLONE_TEST]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/file1.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/file2.txt]
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: update [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/subdir/file20.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: Waiting for transfers to finish
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2: list [/rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/subdir]
2024/11/07 01:19:10 NOTICE: (01)  : test filtersfile-checks
2024/11/07 01:19:10 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:10 NOTICE: (03)  : bisync resync
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:10 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:10 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:10 INFO  : Resync updating listings
2024/11/07 01:19:10 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Bisync successful
2024/11/07 01:19:10 NOTICE: (04)  : test 1. inject filters file in workdir.
2024/11/07 01:19:10 NOTICE: (05)  : copy-file /tmp/011859lo/datadir/test_filtersfile_checks-vogigad6/filtersfile.txt /tmp/011859lo/workdir/
2024/11/07 01:19:10 INFO  : filtersfile.txt: Copied (new)
2024/11/07 01:19:10 NOTICE: (06)  : test 2. run with filters-file but without md5. should abort.
2024/11/07 01:19:10 NOTICE: (07)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 ERROR : Bisync critical error: filters file md5 hash not found (must run --resync): /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:10 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:10 NOTICE: (08)  : test 3. run without filters-file. should be blocked due to prior abort.
2024/11/07 01:19:10 NOTICE: (09)  : bisync
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 
Tip: here are the filenames we were looking for. Do they exist? 
Path1: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_filtersfile_checks_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_filtersfile_checks_path2.path1.lst
Path2: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_filtersfile_checks_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_filtersfile_checks_path2.path2.lst
Try running this command to inspect the work dir: 
rclone lsl "/tmp/011859lo/workdir"
2024/11/07 01:19:10 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:10 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:10 NOTICE: (10)  : test 4. run with filters-file and resync.
2024/11/07 01:19:10 NOTICE: (11)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.txt resync
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Storing filters file hash to /tmp/011859lo/workdir/filtersfile.txt.md5
2024/11/07 01:19:10 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:10 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:10 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:10 INFO  : Resync updating listings
2024/11/07 01:19:10 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Bisync successful
2024/11/07 01:19:10 NOTICE: (12)  : test 5. run with filters-file alone. should run.
2024/11/07 01:19:10 NOTICE: (13)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:10 INFO  : Path1 checking for diffs
2024/11/07 01:19:10 INFO  : Path2 checking for diffs
2024/11/07 01:19:10 INFO  : No changes found
2024/11/07 01:19:10 INFO  : Updating listings
2024/11/07 01:19:10 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Bisync successful
2024/11/07 01:19:10 NOTICE: (14)  : test 6. push changed filters-file to workdir.
2024/11/07 01:19:10 NOTICE: (15)  : copy-as /tmp/011859lo/datadir/test_filtersfile_checks-vogigad6/filtersfile2.txt /tmp/011859lo/workdir/ filtersfile.txt
2024/11/07 01:19:10 INFO  : filtersfile2.txt: Copied (replaced existing) to: filtersfile.txt
2024/11/07 01:19:10 NOTICE: (16)  : test 7. run with filters-file alone. should abort.
2024/11/07 01:19:10 NOTICE: (17)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:10 NOTICE: Bisync error: bisync aborted
2024/11/07 01:19:10 NOTICE: (18)  : test 8. run with filters-file and resync and dry-run. should do the dry-run but still cause next non-resync run to abort.
2024/11/07 01:19:10 NOTICE: (19)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.txt resync dry-run
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Skipped storing filters file hash to /tmp/011859lo/workdir/filtersfile.txt.md5 as --dry-run is set
2024/11/07 01:19:10 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:10 NOTICE: - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:10 NOTICE: - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:10 INFO  : Resync updating listings
2024/11/07 01:19:10 INFO  : Bisync successful
2024/11/07 01:19:10 NOTICE: (20)  : test 9. run with filters-file alone. should abort.
2024/11/07 01:19:10 NOTICE: (21)  : bisync filters-file=/tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:10 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:10 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/filtersfile_checks/path2/"
2024/11/07 01:19:10 INFO  : Using filters file /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 ERROR : Bisync critical error: filters file has changed (must run --resync): /tmp/011859lo/workdir/filtersfile.txt
2024/11/07 01:19:10 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:10 NOTICE: Bisync error: bisync aborted
    bisync_test.go:558: TEST filtersfile_checks PASSED
=== RUN   TestBisyncRemoteRemote/ignorelistingchecksum
2024/11/07 01:19:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:10 DEBUG : path1: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1"
2024/11/07 01:19:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1"
2024/11/07 01:19:10 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:10 DEBUG : path2: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:10 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2"
2024/11/07 01:19:10 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:10 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:10 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:10 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2"
2024/11/07 01:19:10 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_ignorelistingchecksum-yawusar6"
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:10 INFO  : subdir: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:19:10 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:19:10 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/initdir/test_ignorelistingchecksum-yawusar6: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/initdir/test_ignorelistingchecksum-yawusar6: Waiting for transfers to finish
2024/11/07 01:19:10 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:19:10 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:19:10 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:19:10 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:10 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:10 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:19:10 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:10 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:10 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_ignorelistingchecksum-tuvamus2"
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/datadir/test_ignorelistingchecksum-tuvamus2: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : Local file system at /tmp/011859lo/datadir/test_ignorelistingchecksum-tuvamus2: Waiting for transfers to finish
2024/11/07 01:19:10 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:10 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1]
2024/11/07 01:19:10 ERROR : : error listing: directory not found
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2]
2024/11/07 01:19:10 ERROR : : error listing: directory not found
2024/11/07 01:19:10 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_ignorelistingchecksum-yawusar6
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1]
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/RCLONE_TEST]
2024/11/07 01:19:10 DEBUG : subdir: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/subdir]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.copy2.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.copy3.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.copy1.txt]
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: Waiting for transfers to finish
2024/11/07 01:19:10 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.copy4.txt]
2024/11/07 01:19:10 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.copy5.txt]
2024/11/07 01:19:10 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.txt]
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/subdir/file20.txt]
2024/11/07 01:19:10 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/subdir]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2]
2024/11/07 01:19:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : subdir: Making directory
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/subdir]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/RCLONE_TEST]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/file1.copy1.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/file1.copy2.txt]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/file1.copy3.txt]
2024/11/07 01:19:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: Waiting for checks to finish
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: Waiting for transfers to finish
2024/11/07 01:19:10 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/file1.copy4.txt]
2024/11/07 01:19:10 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/file1.copy5.txt]
2024/11/07 01:19:10 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/file1.txt]
2024/11/07 01:19:10 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: update [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/subdir/file20.txt]
2024/11/07 01:19:10 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:10 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:10 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:10 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2]
2024/11/07 01:19:10 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2: list [/rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/subdir]
2024/11/07 01:19:10 NOTICE: (01)  : test basic
2024/11/07 01:19:10 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:10 NOTICE: (03)  : bisync resync
2024/11/07 01:19:11 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:11 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:11 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/"
2024/11/07 01:19:11 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:11 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:11 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:11 INFO  : Resync updating listings
2024/11/07 01:19:11 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/"
2024/11/07 01:19:11 INFO  : Bisync successful
2024/11/07 01:19:11 NOTICE: (04)  : bisync resync ignore-listing-checksum
2024/11/07 01:19:11 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:11 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/"
2024/11/07 01:19:11 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:11 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:11 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:11 INFO  : Resync updating listings
2024/11/07 01:19:11 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/"
2024/11/07 01:19:11 INFO  : Bisync successful
2024/11/07 01:19:11 NOTICE: (05)  : test place newer files on both paths
2024/11/07 01:19:11 NOTICE: (06)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_ignorelistingchecksum-tuvamus2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/
2024/11/07 01:19:11 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:11 NOTICE: (07)  : copy-as /tmp/011859lo/datadir/test_ignorelistingchecksum-tuvamus2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/subdir file20.txt
2024/11/07 01:19:11 INFO  : file1.txt: Copied (replaced existing) to: file20.txt
2024/11/07 01:19:11 NOTICE: (08)  : test bisync run
2024/11/07 01:19:11 NOTICE: (09)  : bisync ignore-listing-checksum
2024/11/07 01:19:11 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:11 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/"
2024/11/07 01:19:11 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:11 INFO  : Path1 checking for diffs
2024/11/07 01:19:11 INFO  : - Path1    File changed: size (larger), time (newer) - subdir/file20.txt
2024/11/07 01:19:11 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:11 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:11 INFO  : Path2 checking for diffs
2024/11/07 01:19:11 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:11 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:11 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:11 INFO  : Applying changes
2024/11/07 01:19:11 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/subdir/file20.txt
2024/11/07 01:19:11 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/file1.txt
2024/11/07 01:19:11 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:11 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:11 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:11 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:19:11 INFO  : Updating listings
2024/11/07 01:19:11 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/ignorelistingchecksum/path2/"
2024/11/07 01:19:11 INFO  : Bisync successful
    bisync_test.go:558: TEST ignorelistingchecksum PASSED
=== RUN   TestBisyncRemoteRemote/max_delete_path1
2024/11/07 01:19:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:11 DEBUG : path1: Making directory
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1"
2024/11/07 01:19:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1"
2024/11/07 01:19:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:11 DEBUG : path2: Making directory
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2"
2024/11/07 01:19:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2"
2024/11/07 01:19:11 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_max_delete_path1-tarenuz5"
2024/11/07 01:19:11 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/initdir/test_max_delete_path1-tarenuz5: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/initdir/test_max_delete_path1-tarenuz5: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:11 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:11 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:11 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:11 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:11 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:11 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:11 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:11 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:11 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:19:11 INFO  : file9.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_max_delete_path1-sadepuj4"
2024/11/07 01:19:11 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/datadir/test_max_delete_path1-sadepuj4: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/datadir/test_max_delete_path1-sadepuj4: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:19:11 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:19:11 INFO  : hold.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1]
2024/11/07 01:19:11 ERROR : : error listing: directory not found
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2]
2024/11/07 01:19:11 ERROR : : error listing: directory not found
2024/11/07 01:19:11 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_max_delete_path1-tarenuz5
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1]
2024/11/07 01:19:11 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file1.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file3.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file2.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file4.txt]
2024/11/07 01:19:11 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file5.txt]
2024/11/07 01:19:11 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file6.txt]
2024/11/07 01:19:11 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file7.txt]
2024/11/07 01:19:11 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file8.txt]
2024/11/07 01:19:11 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file9.txt]
2024/11/07 01:19:11 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file9.txt: Copied (new)
2024/11/07 01:19:11 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2]
2024/11/07 01:19:11 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file1.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file3.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file4.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file2.txt]
2024/11/07 01:19:11 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file5.txt]
2024/11/07 01:19:11 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file6.txt]
2024/11/07 01:19:11 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file7.txt]
2024/11/07 01:19:11 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file8.txt]
2024/11/07 01:19:11 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file9.txt]
2024/11/07 01:19:11 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file9.txt: Copied (new)
2024/11/07 01:19:11 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2]
2024/11/07 01:19:11 NOTICE: (01)  : test max-delete-path1
2024/11/07 01:19:11 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:11 NOTICE: (03)  : bisync resync
2024/11/07 01:19:11 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:11 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:11 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/"
2024/11/07 01:19:11 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:11 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:11 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:11 INFO  : Resync updating listings
2024/11/07 01:19:11 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/"
2024/11/07 01:19:11 INFO  : Bisync successful
2024/11/07 01:19:11 NOTICE: (04)  : test delete >50% of local files
2024/11/07 01:19:11 NOTICE: (05)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file1.txt
2024/11/07 01:19:11 INFO  : file1.txt: Deleted
2024/11/07 01:19:11 NOTICE: (06)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file2.txt
2024/11/07 01:19:11 INFO  : file2.txt: Deleted
2024/11/07 01:19:11 NOTICE: (07)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file3.txt
2024/11/07 01:19:11 INFO  : file3.txt: Deleted
2024/11/07 01:19:11 NOTICE: (08)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file4.txt
2024/11/07 01:19:11 INFO  : file4.txt: Deleted
2024/11/07 01:19:11 NOTICE: (09)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/file5.txt
2024/11/07 01:19:11 INFO  : file5.txt: Deleted
2024/11/07 01:19:11 NOTICE: (10)  : test sync should fail due to too many local deletes
2024/11/07 01:19:11 NOTICE: (11)  : bisync
2024/11/07 01:19:11 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:11 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:11 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/"
2024/11/07 01:19:11 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:11 INFO  : Path1 checking for diffs
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file1.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file2.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file3.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file5.txt
2024/11/07 01:19:11 INFO  : Path1:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:19:11 INFO  : Path2 checking for diffs
2024/11/07 01:19:11 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/". Run with --force if desired.
2024/11/07 01:19:11 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:19:11 NOTICE: Bisync error: too many deletes
2024/11/07 01:19:11 NOTICE: (12)  : copy-listings initial-fail
2024/11/07 01:19:11 NOTICE: (13)  : test change max-delete limit to 60%. sync should run.
2024/11/07 01:19:11 NOTICE: (14)  : bisync max-delete=60
2024/11/07 01:19:11 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:11 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:11 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/"
2024/11/07 01:19:11 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:11 INFO  : Path1 checking for diffs
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file1.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file2.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file3.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:19:11 INFO  : - Path1    File was deleted          - file5.txt
2024/11/07 01:19:11 INFO  : Path1:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:19:11 INFO  : Path2 checking for diffs
2024/11/07 01:19:11 INFO  : Applying changes
2024/11/07 01:19:11 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file1.txt
2024/11/07 01:19:11 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file2.txt
2024/11/07 01:19:11 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file3.txt
2024/11/07 01:19:11 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file4.txt
2024/11/07 01:19:11 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/file5.txt
2024/11/07 01:19:11 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:11 INFO  : file4.txt: Deleted
2024/11/07 01:19:11 INFO  : file5.txt: Deleted
2024/11/07 01:19:11 INFO  : file1.txt: Deleted
2024/11/07 01:19:11 INFO  : file3.txt: Deleted
2024/11/07 01:19:11 INFO  : file2.txt: Deleted
2024/11/07 01:19:11 INFO  : Updating listings
2024/11/07 01:19:11 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path1/path2/"
2024/11/07 01:19:11 INFO  : Bisync successful
    bisync_test.go:558: TEST max_delete_path1 PASSED
=== RUN   TestBisyncRemoteRemote/max_delete_path2_force
2024/11/07 01:19:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:11 DEBUG : path1: Making directory
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1"
2024/11/07 01:19:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1"
2024/11/07 01:19:11 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:11 DEBUG : path2: Making directory
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:11 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2"
2024/11/07 01:19:11 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:11 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:11 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:11 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2"
2024/11/07 01:19:11 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_max_delete_path2_force-kirunig3"
2024/11/07 01:19:11 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/initdir/test_max_delete_path2_force-kirunig3: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/initdir/test_max_delete_path2_force-kirunig3: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:11 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:11 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:11 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:11 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:11 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:11 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:11 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:11 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:11 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : file9.txt: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:11 DEBUG : file9.txt.cf9a93ac.partial: renamed to: file9.txt
2024/11/07 01:19:11 INFO  : file9.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_max_delete_path2_force-salesuj4"
2024/11/07 01:19:11 DEBUG : hold.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/datadir/test_max_delete_path2_force-salesuj4: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : Local file system at /tmp/011859lo/datadir/test_max_delete_path2_force-salesuj4: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK
2024/11/07 01:19:11 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt
2024/11/07 01:19:11 INFO  : hold.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1]
2024/11/07 01:19:11 ERROR : : error listing: directory not found
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2]
2024/11/07 01:19:11 ERROR : : error listing: directory not found
2024/11/07 01:19:11 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_max_delete_path2_force-kirunig3
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1]
2024/11/07 01:19:11 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file1.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file2.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file3.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file4.txt]
2024/11/07 01:19:11 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file5.txt]
2024/11/07 01:19:11 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file6.txt]
2024/11/07 01:19:11 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file7.txt]
2024/11/07 01:19:11 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file8.txt]
2024/11/07 01:19:11 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file9.txt]
2024/11/07 01:19:11 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file9.txt: Copied (new)
2024/11/07 01:19:11 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2]
2024/11/07 01:19:11 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : file9.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file1.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file2.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: Waiting for checks to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: Waiting for transfers to finish
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file4.txt]
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file3.txt]
2024/11/07 01:19:11 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file5.txt]
2024/11/07 01:19:11 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file6.txt]
2024/11/07 01:19:11 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file7.txt]
2024/11/07 01:19:11 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file8.txt]
2024/11/07 01:19:11 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:11 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: update [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file9.txt]
2024/11/07 01:19:11 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:11 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file9.txt: Copied (new)
2024/11/07 01:19:12 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2: list [/rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2]
2024/11/07 01:19:12 NOTICE: (01)  : test max-delete-path2-force
2024/11/07 01:19:12 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:12 NOTICE: (03)  : bisync resync
2024/11/07 01:19:12 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:12 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:12 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/"
2024/11/07 01:19:12 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:12 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:12 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:12 INFO  : Resync updating listings
2024/11/07 01:19:12 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/"
2024/11/07 01:19:12 INFO  : Bisync successful
2024/11/07 01:19:12 NOTICE: (04)  : test delete >50% of remote files
2024/11/07 01:19:12 NOTICE: (05)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file1.txt
2024/11/07 01:19:12 INFO  : file1.txt: Deleted
2024/11/07 01:19:12 NOTICE: (06)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file2.txt
2024/11/07 01:19:12 INFO  : file2.txt: Deleted
2024/11/07 01:19:12 NOTICE: (07)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file3.txt
2024/11/07 01:19:12 INFO  : file3.txt: Deleted
2024/11/07 01:19:12 NOTICE: (08)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file4.txt
2024/11/07 01:19:12 INFO  : file4.txt: Deleted
2024/11/07 01:19:12 NOTICE: (09)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/file5.txt
2024/11/07 01:19:12 INFO  : file5.txt: Deleted
2024/11/07 01:19:12 NOTICE: (10)  : test sync should fail due to too many path2 deletes
2024/11/07 01:19:12 NOTICE: (11)  : bisync
2024/11/07 01:19:12 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:12 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:12 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/"
2024/11/07 01:19:12 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:12 INFO  : Path1 checking for diffs
2024/11/07 01:19:12 INFO  : Path2 checking for diffs
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file1.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file2.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file4.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file5.txt
2024/11/07 01:19:12 INFO  : Path2:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:19:12 ERROR : Safety abort: too many deletes (>50%, 5 of 9) on Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/". Run with --force if desired.
2024/11/07 01:19:12 NOTICE: Bisync aborted. Please try again.
2024/11/07 01:19:12 NOTICE: Bisync error: too many deletes
2024/11/07 01:19:12 NOTICE: (12)  : copy-listings initial-fail
2024/11/07 01:19:12 NOTICE: (13)  : test apply force option. sync should run.
2024/11/07 01:19:12 NOTICE: (14)  : bisync force
2024/11/07 01:19:12 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:12 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:12 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/"
2024/11/07 01:19:12 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:12 INFO  : Path1 checking for diffs
2024/11/07 01:19:12 INFO  : Path2 checking for diffs
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file1.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file2.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file4.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file5.txt
2024/11/07 01:19:12 INFO  : Path2:    5 changes:    0 new,    0 modified,    5 deleted
2024/11/07 01:19:12 INFO  : Applying changes
2024/11/07 01:19:12 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file1.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file2.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file3.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file4.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/file5.txt
2024/11/07 01:19:12 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:12 INFO  : file5.txt: Deleted
2024/11/07 01:19:12 INFO  : file1.txt: Deleted
2024/11/07 01:19:12 INFO  : file2.txt: Deleted
2024/11/07 01:19:12 INFO  : file3.txt: Deleted
2024/11/07 01:19:12 INFO  : file4.txt: Deleted
2024/11/07 01:19:12 INFO  : Updating listings
2024/11/07 01:19:12 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/max_delete_path2_force/path2/"
2024/11/07 01:19:12 INFO  : Bisync successful
    bisync_test.go:558: TEST max_delete_path2_force PASSED
=== RUN   TestBisyncRemoteRemote/nomodtime
2024/11/07 01:19:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:12 DEBUG : path1: Making directory
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1"
2024/11/07 01:19:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1"
2024/11/07 01:19:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:12 DEBUG : path2: Making directory
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2"
2024/11/07 01:19:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2"
2024/11/07 01:19:12 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_nomodtime-tigelar7"
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/initdir/test_nomodtime-tigelar7: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/initdir/test_nomodtime-tigelar7: Waiting for transfers to finish
2024/11/07 01:19:12 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:12 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:12 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:12 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:12 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:12 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:12 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:12 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:12 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:12 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:12 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:12 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_nomodtime-nupunop0"
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/datadir/test_nomodtime-nupunop0: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/datadir/test_nomodtime-nupunop0: Waiting for transfers to finish
2024/11/07 01:19:12 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:12 DEBUG : file10.txt.7d45770.partial: renamed to: file10.txt
2024/11/07 01:19:12 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:12 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:19:12 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:12 DEBUG : file1.txt.7d45770.partial: renamed to: file1.txt
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file11.txt.7d45770.partial: renamed to: file11.txt
2024/11/07 01:19:12 DEBUG : file2.txt.21f2ec7f.partial: renamed to: file2.txt
2024/11/07 01:19:12 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:19:12 DEBUG : file5L.txt.9ed658ed.partial: renamed to: file5L.txt
2024/11/07 01:19:12 INFO  : file5L.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:19:12 DEBUG : file5R.txt.9ed658ed.partial: renamed to: file5R.txt
2024/11/07 01:19:12 INFO  : file5R.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:12 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:12 DEBUG : file7.txt.7d45770.partial: renamed to: file7.txt
2024/11/07 01:19:12 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : file6.txt.7d45770.partial: renamed to: file6.txt
2024/11/07 01:19:12 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: list [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1]
2024/11/07 01:19:12 ERROR : : error listing: directory not found
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: list [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2]
2024/11/07 01:19:12 ERROR : : error listing: directory not found
2024/11/07 01:19:12 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_nomodtime-tigelar7
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: list [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1]
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file1.txt]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: Waiting for transfers to finish
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file3.txt]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/RCLONE_TEST]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file2.txt]
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file4.txt]
2024/11/07 01:19:12 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file5.txt]
2024/11/07 01:19:12 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file6.txt]
2024/11/07 01:19:12 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file7.txt]
2024/11/07 01:19:12 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file8.txt]
2024/11/07 01:19:12 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:12 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1: list [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: list [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2]
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file1.txt]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/RCLONE_TEST]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file2.txt]
2024/11/07 01:19:12 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file3.txt]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: Waiting for transfers to finish
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file4.txt]
2024/11/07 01:19:12 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file5.txt]
2024/11/07 01:19:12 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file6.txt]
2024/11/07 01:19:12 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file7.txt]
2024/11/07 01:19:12 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: update [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file8.txt]
2024/11/07 01:19:12 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:12 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2: list [/rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2]
2024/11/07 01:19:12 NOTICE: (01)  : test changes
2024/11/07 01:19:12 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:12 NOTICE: (03)  : bisync resync nomodtime
2024/11/07 01:19:12 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:12 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/"
2024/11/07 01:19:12 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:12 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:12 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:12 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:12 INFO  : Resync updating listings
2024/11/07 01:19:12 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/"
2024/11/07 01:19:12 INFO  : Bisync successful
2024/11/07 01:19:12 NOTICE: (04)  : test make modifications on both paths
2024/11/07 01:19:12 NOTICE: (05)  : test new on path2 - file10
2024/11/07 01:19:12 NOTICE: (06)  : copy-file /tmp/011859lo/datadir/test_nomodtime-nupunop0/file10.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/
2024/11/07 01:19:12 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:12 NOTICE: (07)  : test changed on path2 - file1
2024/11/07 01:19:12 NOTICE: (08)  : copy-file /tmp/011859lo/datadir/test_nomodtime-nupunop0/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/
2024/11/07 01:19:12 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:12 NOTICE: (09)  : test new on path1 - file11
2024/11/07 01:19:12 NOTICE: (10)  : copy-file /tmp/011859lo/datadir/test_nomodtime-nupunop0/file11.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/
2024/11/07 01:19:12 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:12 NOTICE: (11)  : test changed on path1 - file2
2024/11/07 01:19:12 NOTICE: (12)  : copy-file /tmp/011859lo/datadir/test_nomodtime-nupunop0/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/
2024/11/07 01:19:12 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:12 NOTICE: (13)  : test deleted on path2 - file3
2024/11/07 01:19:12 NOTICE: (14)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file3.txt
2024/11/07 01:19:12 INFO  : file3.txt: Deleted
2024/11/07 01:19:12 NOTICE: (15)  : test deleted on path1 - file4
2024/11/07 01:19:12 NOTICE: (16)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file4.txt
2024/11/07 01:19:12 INFO  : file4.txt: Deleted
2024/11/07 01:19:12 NOTICE: (17)  : test deleted on both paths - file8
2024/11/07 01:19:12 NOTICE: (18)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file8.txt
2024/11/07 01:19:12 INFO  : file8.txt: Deleted
2024/11/07 01:19:12 NOTICE: (19)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file8.txt
2024/11/07 01:19:12 INFO  : file8.txt: Deleted
2024/11/07 01:19:12 NOTICE: (20)  : test changed on both paths - file5 (file5R, file5L)
2024/11/07 01:19:12 NOTICE: (21)  : copy-as /tmp/011859lo/datadir/test_nomodtime-nupunop0/file5R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/ file5.txt
2024/11/07 01:19:12 INFO  : file5R.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:12 NOTICE: (22)  : copy-as /tmp/011859lo/datadir/test_nomodtime-nupunop0/file5L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/ file5.txt
2024/11/07 01:19:12 INFO  : file5L.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:12 NOTICE: (23)  : test changed on path2 and deleted on path1 - file6
2024/11/07 01:19:12 NOTICE: (24)  : copy-file /tmp/011859lo/datadir/test_nomodtime-nupunop0/file6.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/
2024/11/07 01:19:12 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:19:12 NOTICE: (25)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file6.txt
2024/11/07 01:19:12 INFO  : file6.txt: Deleted
2024/11/07 01:19:12 NOTICE: (26)  : test changed on path1 and deleted on path2 - file7
2024/11/07 01:19:12 NOTICE: (27)  : copy-file /tmp/011859lo/datadir/test_nomodtime-nupunop0/file7.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/
2024/11/07 01:19:12 INFO  : file7.txt: Copied (replaced existing)
2024/11/07 01:19:12 NOTICE: (28)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file7.txt
2024/11/07 01:19:12 INFO  : file7.txt: Deleted
2024/11/07 01:19:12 NOTICE: (29)  : test bisync run
2024/11/07 01:19:12 NOTICE: (30)  : bisync nomodtime
2024/11/07 01:19:12 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:12 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/"
2024/11/07 01:19:12 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:12 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:12 INFO  : Path1 checking for diffs
2024/11/07 01:19:12 INFO  : - Path1    File changed: size (larger), hash - file2.txt
2024/11/07 01:19:12 INFO  : - Path1    File was deleted          - file4.txt
2024/11/07 01:19:12 INFO  : - Path1    File changed: size (larger), hash - file5.txt
2024/11/07 01:19:12 INFO  : - Path1    File was deleted          - file6.txt
2024/11/07 01:19:12 INFO  : - Path1    File changed: size (larger), hash - file7.txt
2024/11/07 01:19:12 INFO  : - Path1    File was deleted          - file8.txt
2024/11/07 01:19:12 INFO  : - Path1    File is new               - file11.txt
2024/11/07 01:19:12 INFO  : Path1:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:19:12 INFO  : (Modified:    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:19:12 INFO  : Path2 checking for diffs
2024/11/07 01:19:12 INFO  : - Path2    File changed: size (larger), hash - file1.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file3.txt
2024/11/07 01:19:12 INFO  : - Path2    File changed: size (larger), hash - file5.txt
2024/11/07 01:19:12 INFO  : - Path2    File changed: size (larger), hash - file6.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file7.txt
2024/11/07 01:19:12 INFO  : - Path2    File was deleted          - file8.txt
2024/11/07 01:19:12 INFO  : - Path2    File is new               - file10.txt
2024/11/07 01:19:12 INFO  : Path2:    7 changes:    1 new,    3 modified,    3 deleted
2024/11/07 01:19:12 INFO  : (Modified:    3 larger,    0 smaller,    3 hash differs)
2024/11/07 01:19:12 INFO  : Applying changes
2024/11/07 01:19:12 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file11.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file2.txt
2024/11/07 01:19:12 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file4.txt
2024/11/07 01:19:12 NOTICE: - WARNING  New or changed in both paths       - file5.txt
2024/11/07 01:19:12 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file5.txt.conflict1
2024/11/07 01:19:12 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict1
2024/11/07 01:19:12 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file5.txt.conflict1
2024/11/07 01:19:12 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file5.txt.conflict2
2024/11/07 01:19:12 INFO  : file5.txt: Moved (server-side) to: file5.txt.conflict2
2024/11/07 01:19:12 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file5.txt.conflict2
2024/11/07 01:19:12 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file6.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/file7.txt
2024/11/07 01:19:12 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file1.txt
2024/11/07 01:19:12 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file10.txt
2024/11/07 01:19:12 INFO  : - Path1    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/file3.txt
2024/11/07 01:19:12 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:12 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file5.txt.conflict2: Copied (new)
2024/11/07 01:19:12 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:12 INFO  : file3.txt: Deleted
2024/11/07 01:19:12 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:12 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file5.txt.conflict1: Copied (new)
2024/11/07 01:19:12 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:12 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:12 INFO  : file4.txt: Deleted
2024/11/07 01:19:12 INFO  : Updating listings
2024/11/07 01:19:12 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/nomodtime/path2/"
2024/11/07 01:19:12 INFO  : Bisync successful
    bisync_test.go:558: TEST nomodtime PASSED
=== RUN   TestBisyncRemoteRemote/normalization
2024/11/07 01:19:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:12 DEBUG : path1: Making directory
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/normalization/path1"
2024/11/07 01:19:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/normalization/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1"
2024/11/07 01:19:12 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:12 DEBUG : path2: Making directory
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:12 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/normalization/path2"
2024/11/07 01:19:12 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:12 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:12 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:12 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/normalization/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2"
2024/11/07 01:19:12 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_normalization-bacawok0"
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory with metadata
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ: Made directory with metadata (mtime=2024-01-25T05:00:02.874776175Z)
2024/11/07 01:19:12 DEBUG : Added delayed dir = "測試_Ру��кий_ _ _ě_áñ", newDst=測試_Ру��кий_ _ _ě_áñ
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/initdir/test_normalization-bacawok0: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/initdir/test_normalization-bacawok0: Waiting for transfers to finish
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file.5028a97.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/測試_check file
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: md5 = 0033328434f9662a7dae0d1aee7768b6 OK
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt.480f4fd7.partial: renamed to: 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:12 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:12 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ: Set directory modification time (using SetModTime)
2024/11/07 01:19:12 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_normalization-wesuzil6"
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_filtersfile.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/datadir/test_normalization-wesuzil6: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : Local file system at /tmp/011859lo/datadir/test_normalization-wesuzil6: Waiting for transfers to finish
2024/11/07 01:19:12 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:12 DEBUG : file1.txt.925c801f.partial: renamed to: file1.txt
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : 測試_filtersfile.txt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK
2024/11/07 01:19:12 DEBUG : 測試_filtersfile.txt.e8d47346.partial: renamed to: 測試_filtersfile.txt
2024/11/07 01:19:12 INFO  : 測試_filtersfile.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1]
2024/11/07 01:19:12 ERROR : : error listing: directory not found
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2]
2024/11/07 01:19:12 ERROR : : error listing: directory not found
2024/11/07 01:19:12 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_normalization-bacawok0
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1]
2024/11/07 01:19:12 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/RCLONE_TEST]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/file1.txt]
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: Waiting for checks to finish
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt]
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: Waiting for transfers to finish
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:12 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру��кий_ _ _ě_áñ/測試_check file]
2024/11/07 01:19:12 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:12 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:13 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:13 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:19:13 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1]
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path1: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2]
2024/11/07 01:19:13 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:13 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:13 DEBUG : 測試_Ру��кий_ _ _ě_áñ: Making directory
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/RCLONE_TEST]
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/file1.txt]
2024/11/07 01:19:13 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:13 DEBUG : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:13 DEBUG : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Need to transfer - File not found at Destination
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt]
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: Waiting for checks to finish
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: Waiting for transfers to finish
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt]
2024/11/07 01:19:13 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ě_.txt: Copied (new)
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: update [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру��кий_ _ _ě_áñ/測試_check file]
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:13 INFO  : 測試_Ру��кий_ _ _ě_áñ/filename_contains_ࢺ_.txt: Copied (new)
2024/11/07 01:19:13 INFO  : 測試_Ру��кий_ _ _ě_áñ/測試_check file: Copied (new)
2024/11/07 01:19:13 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:13 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2]
2024/11/07 01:19:13 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: list [/rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру��кий_ _ _ě_áñ]
2024/11/07 01:19:13 NOTICE: (01)  : test normalization
2024/11/07 01:19:13 NOTICE: (02)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/
2024/11/07 01:19:13 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:13 NOTICE: (03)  : test initial bisync
2024/11/07 01:19:13 NOTICE: (04)  : bisync resync
2024/11/07 01:19:13 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:13 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:13 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:13 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:13 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:13 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:13 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:13 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:13 INFO  : Resync updating listings
2024/11/07 01:19:13 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Bisync successful
2024/11/07 01:19:13 NOTICE: (05)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру��кий___ě_a�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö 測試_Ру��кий___ě_a�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: 測試_Ру��кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö.txt
2024/11/07 01:19:13 NOTICE: (06)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/folder e�e�e�ö.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: éééö.txt
2024/11/07 01:19:13 NOTICE: (07)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/folder HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: HeLlO,wOrLd!.txt
2024/11/07 01:19:13 NOTICE: (08)  : touch-copy 2001-01-03 /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/
2024/11/07 01:19:13 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:13 NOTICE: (09)  : copy-as-NFD /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/folder e�e�e�ö.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: e�e�e�ö.txt
2024/11/07 01:19:13 NOTICE: (10)  : copy-as-NFD /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/folder hello,WORLD!.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: hello,WORLD!.txt
2024/11/07 01:19:13 NOTICE: (11)  : test bisync run with fix-case
2024/11/07 01:19:13 NOTICE: (12)  : bisync fix-case
2024/11/07 01:19:13 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:13 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:13 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:13 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:13 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:13 INFO  : Path1 checking for diffs
2024/11/07 01:19:13 INFO  : - Path1    File is new               - folder/HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : - Path1    File is new               - folder/éééö.txt
2024/11/07 01:19:13 INFO  : - Path1    File is new               - "測試_Ру��кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö/測試_Ру��кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö.txt"
2024/11/07 01:19:13 INFO  : Path1:    3 changes:    3 new,    0 modified,    0 deleted
2024/11/07 01:19:13 INFO  : Path2 checking for diffs
2024/11/07 01:19:13 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:13 INFO  : - Path2    File is new               - folder/e�e�e�ö.txt
2024/11/07 01:19:13 INFO  : - Path2    File is new               - folder/hello,WORLD!.txt
2024/11/07 01:19:13 INFO  : Path2:    3 changes:    2 new,    1 modified,    0 deleted
2024/11/07 01:19:13 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:13 INFO  : Applying changes
2024/11/07 01:19:13 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:13 INFO  : Checking potential conflicts...
2024/11/07 01:19:13 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: 0 differences found
2024/11/07 01:19:13 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: 2 matching files
2024/11/07 01:19:13 INFO  : Finished checking the potential conflicts. %!s(<nil>)
2024/11/07 01:19:13 NOTICE: - WARNING  New or changed in both paths       - folder/HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : folder/hello,WORLD!.txt: Files are equal but will copy anyway to fix case to folder/HeLlO,wOrLd!.txt
2024/11/07 01:19:13 NOTICE: - WARNING  New or changed in both paths       - folder/éééö.txt
2024/11/07 01:19:13 INFO  : folder/e�e�e�ö.txt: Files are equal but will copy anyway to fix case to folder/éééö.txt
2024/11/07 01:19:13 INFO  : - Path1    Queue copy to Path2       - "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру��кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö/測試_Ру��кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö.txt"
2024/11/07 01:19:13 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/file1.txt
2024/11/07 01:19:13 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:13 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:13 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:13 INFO  : folder/e�e�e�ö.txt: Moved (server-side) to: folder/éééö.txt
2024/11/07 01:19:13 INFO  : folder/e�e�e�ö.txt: Fixed case by renaming to: folder/éééö.txt
2024/11/07 01:19:13 INFO  : folder/hello,WORLD!.txt: Moved (server-side) to: folder/HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : folder/hello,WORLD!.txt: Fixed case by renaming to: folder/HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : 測試_Ру��кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö/測試_Ру��кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö.txt: Copied (new)
2024/11/07 01:19:13 INFO  : folder/éééö.txt: Copied (replaced existing)
2024/11/07 01:19:13 INFO  : folder/HeLlO,wOrLd!.txt: Copied (replaced existing)
2024/11/07 01:19:13 INFO  : Updating listings
2024/11/07 01:19:13 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Bisync successful
2024/11/07 01:19:13 NOTICE: (13)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/
2024/11/07 01:19:13 NOTICE: (14)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/
2024/11/07 01:19:13 NOTICE: (15)  : touch-copy 2001-01-02 /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:13 NOTICE: (16)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/ file2.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: file2.txt
2024/11/07 01:19:13 NOTICE: (17)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/ file3.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: file3.txt
2024/11/07 01:19:13 NOTICE: (18)  : bisync resync
2024/11/07 01:19:13 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:13 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:13 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:13 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:13 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:13 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:13 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:13 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:13 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:13 INFO  : Resync updating listings
2024/11/07 01:19:13 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Bisync successful
2024/11/07 01:19:13 NOTICE: (19)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру�кий___ě_a�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö 測試_Ру�кий___ě_a�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: 測試_Ру�кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö.txt
2024/11/07 01:19:13 NOTICE: (20)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/newfolder e�e�e�ö.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: éééö.txt
2024/11/07 01:19:13 NOTICE: (21)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/newfolder HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: HeLlO,wOrLd!.txt
2024/11/07 01:19:13 NOTICE: (22)  : touch-copy 2001-01-03 /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/
2024/11/07 01:19:13 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:13 NOTICE: (23)  : copy-as-NFD /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/newfolder e�e�e�ö.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: e�e�e�ö.txt
2024/11/07 01:19:13 NOTICE: (24)  : copy-as-NFD /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/newfolder hello,WORLD!.txt
2024/11/07 01:19:13 INFO  : file1.txt: Copied (new) to: hello,WORLD!.txt
2024/11/07 01:19:13 NOTICE: (25)  : test bisync run with normalization
2024/11/07 01:19:13 NOTICE: (26)  : bisync norm force
2024/11/07 01:19:13 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:13 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:13 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:13 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:13 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:13 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:13 INFO  : Path1 checking for diffs
2024/11/07 01:19:13 INFO  : - Path1    File is new               - newfolder/HeLlO,wOrLd!.txt
2024/11/07 01:19:13 INFO  : - Path1    File is new               - newfolder/éééö.txt
2024/11/07 01:19:13 INFO  : - Path1    File is new               - "測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö/測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö.txt"
2024/11/07 01:19:13 INFO  : Path1:    3 changes:    3 new,    0 modified,    0 deleted
2024/11/07 01:19:13 INFO  : Path2 checking for diffs
2024/11/07 01:19:13 INFO  : - Path2    File changed: time (newer) - file1.txt
2024/11/07 01:19:13 INFO  : - Path2    File is new               - newfolder/e�e�e�ö.txt
2024/11/07 01:19:13 INFO  : - Path2    File is new               - newfolder/hello,WORLD!.txt
2024/11/07 01:19:13 INFO  : Path2:    3 changes:    2 new,    1 modified,    0 deleted
2024/11/07 01:19:13 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:19:13 INFO  : Applying changes
2024/11/07 01:19:13 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:13 INFO  : Checking potential conflicts...
2024/11/07 01:19:14 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: 0 differences found
2024/11/07 01:19:14 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/normalization/path2: 2 matching files
2024/11/07 01:19:14 INFO  : Finished checking the potential conflicts. %!s(<nil>)
2024/11/07 01:19:14 NOTICE: - WARNING  New or changed in both paths       - newfolder/HeLlO,wOrLd!.txt
2024/11/07 01:19:14 INFO  : newfolder/HeLlO,wOrLd!.txt: Files are equal but will copy anyway to update modtime (will not rename)
2024/11/07 01:19:14 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/newfolder/HeLlO,wOrLd!.txt
2024/11/07 01:19:14 NOTICE: - WARNING  New or changed in both paths       - newfolder/éééö.txt
2024/11/07 01:19:14 INFO  : newfolder/éééö.txt: Files are equal but will copy anyway to update modtime (will not rename)
2024/11/07 01:19:14 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/newfolder/éééö.txt
2024/11/07 01:19:14 INFO  : - Path1    Queue copy to Path2       - "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö/測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö.txt"
2024/11/07 01:19:14 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/file1.txt
2024/11/07 01:19:14 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:14 INFO  : newfolder/e�e�e�ö.txt: Copied (replaced existing) to: newfolder/éééö.txt
2024/11/07 01:19:14 INFO  : newfolder/hello,WORLD!.txt: Copied (replaced existing) to: newfolder/HeLlO,wOrLd!.txt
2024/11/07 01:19:14 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:14 INFO  : 測試_Ру�кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö/測試_Ру�кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö.txt: Copied (new)
2024/11/07 01:19:14 INFO  : Updating listings
2024/11/07 01:19:14 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:14 INFO  : Bisync successful
2024/11/07 01:19:14 NOTICE: (27)  : test resync
2024/11/07 01:19:14 NOTICE: (28)  : bisync resync norm
2024/11/07 01:19:14 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:14 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:14 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:14 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:14 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:14 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:14 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:14 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:14 INFO  : Resync updating listings
2024/11/07 01:19:14 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:14 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:14 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:14 INFO  : Bisync successful
2024/11/07 01:19:14 NOTICE: (29)  : test changed on one path
2024/11/07 01:19:14 NOTICE: (30)  : touch-copy 2001-01-05 /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path2/
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (31)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/測試_Ру�кий___ě_a�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö 測試_Ру�кий___ě_a�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö.txt
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing) to: 測試_Ру�кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö.txt
2024/11/07 01:19:14 NOTICE: (32)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/newfolder e�e�e�ö.txt
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing) to: éééö.txt
2024/11/07 01:19:14 NOTICE: (33)  : copy-as-NFC /tmp/011859lo/datadir/test_normalization-wesuzil6/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/normalization/path1/newfolder HeLlO,wOrLd!.txt
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing) to: HeLlO,wOrLd!.txt
2024/11/07 01:19:14 NOTICE: (34)  : bisync norm
2024/11/07 01:19:14 INFO  : ě�� a�ñhࢺ_測試ру�кийěa�ñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬e�ö: Copied (new)
2024/11/07 01:19:14 INFO  : ě�� áñhࢺ_測試ру�кийěáñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö: Copied (new)
2024/11/07 01:19:14 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:14 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:14 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:14 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:14 INFO  : Path1 checking for diffs
2024/11/07 01:19:14 INFO  : - Path1    File changed: time (newer) - newfolder/HeLlO,wOrLd!.txt
2024/11/07 01:19:14 INFO  : - Path1    File changed: time (newer) - newfolder/éééö.txt
2024/11/07 01:19:14 INFO  : - Path1    File changed: time (newer) - "測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö/測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö.txt"
2024/11/07 01:19:14 INFO  : Path1:    3 changes:    0 new,    3 modified,    0 deleted
2024/11/07 01:19:14 INFO  : (Modified:    3 newer,    0 older)
2024/11/07 01:19:14 INFO  : Path2 checking for diffs
2024/11/07 01:19:14 INFO  : - Path2    File changed: time (newer) - file1.txt
2024/11/07 01:19:14 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:14 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:19:14 INFO  : Applying changes
2024/11/07 01:19:14 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/newfolder/hello,WORLD!.txt
2024/11/07 01:19:14 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/newfolder/e�e�e�ö.txt
2024/11/07 01:19:14 INFO  : - Path1    Queue copy to Path2       - "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö/測試_Ру�кий___ě_áñ👸���\u200d♀�💆�\u200d♂��🤙�🤮🧑�\u200d🔧🧑\u200d🔬éö.txt"
2024/11/07 01:19:14 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/file1.txt
2024/11/07 01:19:14 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:14 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:14 INFO  : 測試_Ру�кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö/測試_Ру�кий___ě_áñ👸����♀�💆��♂��🤙�🤮🧑��🔧🧑�🔬éö.txt: Copied (replaced existing)
2024/11/07 01:19:14 INFO  : newfolder/éééö.txt: Copied (replaced existing) to: newfolder/e�e�e�ö.txt
2024/11/07 01:19:14 INFO  : newfolder/HeLlO,wOrLd!.txt: Copied (replaced existing) to: newfolder/hello,WORLD!.txt
2024/11/07 01:19:14 INFO  : Updating listings
2024/11/07 01:19:14 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/normalization/path2/"
2024/11/07 01:19:14 INFO  : Bisync successful
    bisync_test.go:558: TEST normalization PASSED
=== RUN   TestBisyncRemoteRemote/rclone_args
2024/11/07 01:19:14 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:14 DEBUG : path1: Making directory
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1"
2024/11/07 01:19:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1"
2024/11/07 01:19:14 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:14 DEBUG : path2: Making directory
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:14 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2"
2024/11/07 01:19:14 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:14 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:14 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:14 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:14 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2"
2024/11/07 01:19:14 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_rclone_args-roxumun0"
2024/11/07 01:19:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:14 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:14 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : Local file system at /tmp/011859lo/initdir/test_rclone_args-roxumun0: Waiting for checks to finish
2024/11/07 01:19:14 DEBUG : Local file system at /tmp/011859lo/initdir/test_rclone_args-roxumun0: Waiting for transfers to finish
2024/11/07 01:19:14 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:14 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:14 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : subdir/file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:14 DEBUG : subdir/file21.txt.5028a97.partial: renamed to: subdir/file21.txt
2024/11/07 01:19:14 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:14 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:14 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:14 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:14 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:14 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : file1.txt: md5 = 06bf632289064f6deae02a9f6f07856c OK
2024/11/07 01:19:14 DEBUG : file1.txt.dae86b42.partial: renamed to: file1.txt
2024/11/07 01:19:14 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:14 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:14 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_rclone_args-hejidid2"
2024/11/07 01:19:14 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:14 DEBUG : file21.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:14 DEBUG : file21.txt.b4075ff1.partial: renamed to: file21.txt
2024/11/07 01:19:14 INFO  : file21.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : file20.txt.b4075ff1.partial: renamed to: file20.txt
2024/11/07 01:19:14 INFO  : file20.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : Local file system at /tmp/011859lo/datadir/test_rclone_args-hejidid2: Waiting for checks to finish
2024/11/07 01:19:14 DEBUG : Local file system at /tmp/011859lo/datadir/test_rclone_args-hejidid2: Waiting for transfers to finish
2024/11/07 01:19:14 DEBUG : file2.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:14 DEBUG : file2.txt.6bedbe24.partial: renamed to: file2.txt
2024/11/07 01:19:14 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:14 DEBUG : file1.txt.6bedbe24.partial: renamed to: file1.txt
2024/11/07 01:19:14 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1]
2024/11/07 01:19:14 ERROR : : error listing: directory not found
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2]
2024/11/07 01:19:14 ERROR : : error listing: directory not found
2024/11/07 01:19:14 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_rclone_args-roxumun0
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1]
2024/11/07 01:19:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : subdir: Making directory
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/file1.txt]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/RCLONE_TEST]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/file2.txt]
2024/11/07 01:19:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/file20.txt]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: Waiting for checks to finish
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: Waiting for transfers to finish
2024/11/07 01:19:14 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/file21.txt]
2024/11/07 01:19:14 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:14 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:14 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:14 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:19:14 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2]
2024/11/07 01:19:14 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : subdir: Making directory
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/file1.txt]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/RCLONE_TEST]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/file2.txt]
2024/11/07 01:19:14 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : subdir/file21.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/file20.txt]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: Waiting for checks to finish
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: Waiting for transfers to finish
2024/11/07 01:19:14 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/file21.txt]
2024/11/07 01:19:14 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:14 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:14 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:14 INFO  : subdir/file21.txt: Copied (new)
2024/11/07 01:19:14 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2]
2024/11/07 01:19:14 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir]
2024/11/07 01:19:14 NOTICE: (01)  : test rclone-args
2024/11/07 01:19:14 NOTICE: (02)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_rclone_args-hejidid2/ *
2024/11/07 01:19:14 NOTICE: (03)  : test initial bisync
2024/11/07 01:19:14 NOTICE: (04)  : bisync resync checksum
2024/11/07 01:19:14 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:14 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:14 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:14 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:14 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:14 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:14 INFO  : Resync updating listings
2024/11/07 01:19:14 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:14 INFO  : Bisync successful
2024/11/07 01:19:14 NOTICE: (05)  : test place newer files on both paths
2024/11/07 01:19:14 NOTICE: (06)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (07)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/
2024/11/07 01:19:14 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (08)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir
2024/11/07 01:19:14 INFO  : file20.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (09)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir
2024/11/07 01:19:14 INFO  : file21.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (10)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/ file1.txt
2024/11/07 01:19:14 NOTICE: (11)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/ file2.txt
2024/11/07 01:19:14 NOTICE: (12)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:19:14 NOTICE: (13)  : touch-glob 2001-01-02 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:19:14 NOTICE: (14)  : test run bisync with custom options
2024/11/07 01:19:14 NOTICE: (15)  : bisync checksum
2024/11/07 01:19:14 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:14 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:14 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:14 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:14 INFO  : Path1 checking for diffs
2024/11/07 01:19:14 INFO  : - Path1    File changed: hash - file1.txt
2024/11/07 01:19:14 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:14 INFO  : (Modified:    1 hash differs)
2024/11/07 01:19:14 INFO  : Path2 checking for diffs
2024/11/07 01:19:14 INFO  : - Path2    File changed: size (larger), hash - file2.txt
2024/11/07 01:19:14 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:14 INFO  : (Modified:    1 larger,    0 smaller,    1 hash differs)
2024/11/07 01:19:14 INFO  : Applying changes
2024/11/07 01:19:14 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/file1.txt
2024/11/07 01:19:14 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/file2.txt
2024/11/07 01:19:14 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:14 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:14 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:14 INFO  : Updating listings
2024/11/07 01:19:14 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:14 INFO  : Bisync successful
2024/11/07 01:19:14 NOTICE: (16)  : touch-glob 2007-07-23 /tmp/011859lo/datadir/test_rclone_args-hejidid2/ *
2024/11/07 01:19:14 NOTICE: (17)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/
2024/11/07 01:19:14 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (18)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/
2024/11/07 01:19:14 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (19)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir
2024/11/07 01:19:14 INFO  : file20.txt: Copied (replaced existing)
2024/11/07 01:19:14 NOTICE: (20)  : copy-as /tmp/011859lo/datadir/test_rclone_args-hejidid2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/ file1.txt
2024/11/07 01:19:14 INFO  : file21.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:14 NOTICE: (21)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/ file1.txt
2024/11/07 01:19:14 NOTICE: (22)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/ file2.txt
2024/11/07 01:19:14 NOTICE: (23)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:19:14 NOTICE: (24)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:19:14 NOTICE: (25)  : bisync size-only
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": false,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File changed: size (smaller) - file1.txt
2024/11/07 01:19:15 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    0 larger,    1 smaller)
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/file1.txt
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (26)  : bisync resync
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:15 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:15 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:15 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : Resync updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (27)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/
2024/11/07 01:19:15 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:15 NOTICE: (28)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file2.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/
2024/11/07 01:19:15 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:15 NOTICE: (29)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir
2024/11/07 01:19:15 NOTICE: (30)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir
2024/11/07 01:19:15 INFO  : file21.txt: Copied (replaced existing)
2024/11/07 01:19:15 NOTICE: (31)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/ file1.txt
2024/11/07 01:19:15 NOTICE: (32)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/ file2.txt
2024/11/07 01:19:15 NOTICE: (33)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:19:15 NOTICE: (34)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:19:15 NOTICE: (35)  : bisync ignore-size
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": false,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File changed: time (newer) - file2.txt
2024/11/07 01:19:15 INFO  : - Path2    File changed: time (newer) - subdir/file21.txt
2024/11/07 01:19:15 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    2 newer,    0 older)
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/file2.txt
2024/11/07 01:19:15 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/file21.txt
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (36)  : bisync resync compare-all
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:15 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:15 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:15 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:15 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : Resync updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (37)  : copy-as /tmp/011859lo/datadir/test_rclone_args-hejidid2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/ file2.txt
2024/11/07 01:19:15 INFO  : file21.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:15 NOTICE: (38)  : touch-glob 2023-08-26 /tmp/011859lo/datadir/test_rclone_args-hejidid2/ *
2024/11/07 01:19:15 NOTICE: (39)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file1.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/
2024/11/07 01:19:15 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:15 NOTICE: (40)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file20.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir
2024/11/07 01:19:15 INFO  : file20.txt: Copied (replaced existing)
2024/11/07 01:19:15 NOTICE: (41)  : copy-file /tmp/011859lo/datadir/test_rclone_args-hejidid2/file21.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir
2024/11/07 01:19:15 INFO  : file21.txt: Copied (replaced existing)
2024/11/07 01:19:15 NOTICE: (42)  : touch-glob 2007-07-23 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/ file2.txt
2024/11/07 01:19:15 NOTICE: (43)  : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/ file1.txt
2024/11/07 01:19:15 NOTICE: (44)  : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/ file20.txt
2024/11/07 01:19:15 NOTICE: (45)  : touch-glob 2023-08-26 TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/ file21.txt
2024/11/07 01:19:15 NOTICE: (46)  : bisync compare-all
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": true,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": true
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : TestHdfs{cNNQW}: Downloading hashes...
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:19:15 INFO  : - Path1    File changed: time (newer) - subdir/file20.txt
2024/11/07 01:19:15 INFO  : Path1:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    2 newer,    0 older)
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File changed: size (smaller), hash - file2.txt
2024/11/07 01:19:15 INFO  : - Path2    File changed: time (newer) - subdir/file21.txt
2024/11/07 01:19:15 INFO  : Path2:    2 changes:    0 new,    2 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    1 newer,    0 older,    0 larger,    1 smaller,    1 hash differs)
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/file1.txt
2024/11/07 01:19:15 INFO  : - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/subdir/file20.txt
2024/11/07 01:19:15 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/file2.txt
2024/11/07 01:19:15 INFO  : - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/subdir/file21.txt
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : subdir/file21.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:15 INFO  : subdir/file20.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rclone_args/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
    bisync_test.go:558: TEST rclone_args PASSED
=== RUN   TestBisyncRemoteRemote/resolve
2024/11/07 01:19:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:15 DEBUG : path1: Making directory
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resolve/path1"
2024/11/07 01:19:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resolve/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1"
2024/11/07 01:19:15 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:15 DEBUG : path2: Making directory
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:15 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resolve/path2"
2024/11/07 01:19:15 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:15 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:15 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:15 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:15 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resolve/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2"
2024/11/07 01:19:15 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_resolve-qoxafav1"
2024/11/07 01:19:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : Local file system at /tmp/011859lo/initdir/test_resolve-qoxafav1: Waiting for checks to finish
2024/11/07 01:19:15 DEBUG : Local file system at /tmp/011859lo/initdir/test_resolve-qoxafav1: Waiting for transfers to finish
2024/11/07 01:19:15 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:15 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:15 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:15 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:15 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:15 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:15 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:15 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:15 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:15 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_resolve-wixezaf1"
2024/11/07 01:19:15 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : Local file system at /tmp/011859lo/datadir/test_resolve-wixezaf1: Waiting for checks to finish
2024/11/07 01:19:15 DEBUG : Local file system at /tmp/011859lo/datadir/test_resolve-wixezaf1: Waiting for transfers to finish
2024/11/07 01:19:15 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:19:15 DEBUG : file1L.txt.711f2f3a.partial: renamed to: file1L.txt
2024/11/07 01:19:15 DEBUG : file1R.txt: md5 = 2b4975bb20f7be674e66d78570ba2fb1 OK
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (new)
2024/11/07 01:19:15 DEBUG : file1R.txt.eafd8cfe.partial: renamed to: file1R.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (new)
2024/11/07 01:19:15 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:19:15 DEBUG : file2.txt.cc713425.partial: renamed to: file2.txt
2024/11/07 01:19:15 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resolve/path1]
2024/11/07 01:19:15 ERROR : : error listing: directory not found
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resolve/path2]
2024/11/07 01:19:15 ERROR : : error listing: directory not found
2024/11/07 01:19:15 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_resolve-qoxafav1
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resolve/path1]
2024/11/07 01:19:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resolve/path1/RCLONE_TEST]
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt]
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: Waiting for checks to finish
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: Waiting for transfers to finish
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file2.txt]
2024/11/07 01:19:15 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:15 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:15 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:15 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resolve/path1]
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resolve/path2]
2024/11/07 01:19:15 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: Waiting for checks to finish
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: Waiting for transfers to finish
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt]
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file2.txt]
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resolve/path2/RCLONE_TEST]
2024/11/07 01:19:15 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:15 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:15 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:15 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2
2024/11/07 01:19:15 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resolve/path2]
2024/11/07 01:19:15 NOTICE: (01)  : test resolve
2024/11/07 01:19:15 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:15 NOTICE: (03)  : bisync resync
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:15 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:15 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:15 INFO  : Resync updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (04)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:15 NOTICE: (05)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1R.txt
2024/11/07 01:19:15 NOTICE: (06)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file1.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:15 NOTICE: (07)  : touch-glob 2001-03-04 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1L.txt
2024/11/07 01:19:15 NOTICE: (08)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file1.txt
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:15 NOTICE: (09)  : test bisync run with --conflict-resolve=newer --conflict-loser=delete --conflict-suffix=potato
2024/11/07 01:19:15 NOTICE: (10)  : bisync conflict-resolve=newer conflict-loser=delete conflict-suffix=potato
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : - Path1    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:15 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File changed: size (larger), time (newer) - file1.txt
2024/11/07 01:19:15 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:15 INFO  : Checking potential conflicts...
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 differences found
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 errors while checking
2024/11/07 01:19:15 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:15 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:15 INFO  : file1.txt: Path1 is newer. Path1: 2001-03-04 00:00:00 +0000 UTC, Path2: 2001-01-02 00:00:00 +0000 UTC, Difference: 1464h0m0s
2024/11/07 01:19:15 INFO  : file1.txt: The winner is: Path1
2024/11/07 01:19:15 NOTICE: - Path2    Deleting Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt
2024/11/07 01:19:15 INFO  : file1.txt: Deleted
2024/11/07 01:19:15 INFO  : - Path1    Queue copy to Path2       - file1.txt
2024/11/07 01:19:15 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:15 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (11)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:15 NOTICE: (12)  : touch-glob 2001-07-23 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1R.txt
2024/11/07 01:19:15 NOTICE: (13)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file1.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:15 NOTICE: (14)  : touch-glob 2001-08-26 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1L.txt
2024/11/07 01:19:15 NOTICE: (15)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file1.txt
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:15 NOTICE: (16)  : test bisync run with --conflict-resolve=path2 --conflict-loser=num --conflict-suffix=dinosaur
2024/11/07 01:19:15 NOTICE: (17)  : bisync conflict-resolve=path2 conflict-loser=num conflict-suffix=dinosaur
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : - Path1    File changed: time (newer) - file1.txt
2024/11/07 01:19:15 INFO  : Path1:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File changed: time (newer) - file1.txt
2024/11/07 01:19:15 INFO  : Path2:    1 changes:    0 new,    1 modified,    0 deleted
2024/11/07 01:19:15 INFO  : (Modified:    1 newer,    0 older)
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:15 INFO  : Checking potential conflicts...
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 differences found
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 errors while checking
2024/11/07 01:19:15 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:15 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:15 INFO  : file1.txt: The winner is: Path2
2024/11/07 01:19:15 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt.dinosaur1
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt.dinosaur1
2024/11/07 01:19:15 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt.dinosaur1
2024/11/07 01:19:15 NOTICE: - Path2    Not renaming Path2 copy, as it was determined the winner - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt
2024/11/07 01:19:15 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:15 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:15 INFO  : file1.txt.dinosaur1: Copied (new)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (18)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:15 NOTICE: (19)  : touch-glob 2002-07-23 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1R.txt
2024/11/07 01:19:15 NOTICE: (20)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file1.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:15 NOTICE: (21)  : touch-glob 2002-08-26 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1L.txt
2024/11/07 01:19:15 NOTICE: (22)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file1.txt
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:15 NOTICE: (23)  : test bisync run with --conflict-resolve=larger --conflict-loser=num --conflict-suffix=apple
2024/11/07 01:19:15 NOTICE: (24)  : bisync conflict-resolve=larger conflict-loser=num conflict-suffix=apple
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:19:15 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:19:15 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:15 INFO  : Checking potential conflicts...
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 differences found
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 errors while checking
2024/11/07 01:19:15 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:15 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:15 INFO  : file1.txt: Winner cannot be determined as sizes are equal. Path1: 33, Path2: 33, Difference: 0
2024/11/07 01:19:15 INFO  : file1.txt: A winner could not be determined.
2024/11/07 01:19:15 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt.apple1
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt.apple1
2024/11/07 01:19:15 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt.apple1
2024/11/07 01:19:15 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt.apple2
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt.apple2
2024/11/07 01:19:15 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt.apple2
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : file1.txt.apple2: Copied (new)
2024/11/07 01:19:15 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:15 INFO  : file1.txt.apple1: Copied (new)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (25)  : test different suffixes
2024/11/07 01:19:15 NOTICE: (26)  : touch-glob 2003-07-23 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1R.txt
2024/11/07 01:19:15 NOTICE: (27)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file1.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:19:15 NOTICE: (28)  : touch-glob 2003-07-23 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1L.txt
2024/11/07 01:19:15 NOTICE: (29)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file1.txt
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:19:15 NOTICE: (30)  : test bisync run with --conflict-resolve=older --conflict-loser=num --conflict-suffix=cloud,local
2024/11/07 01:19:15 NOTICE: (31)  : bisync conflict-resolve=older conflict-loser=num conflict-suffix=cloud,local
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:19:15 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:19:15 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:15 INFO  : Checking potential conflicts...
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 differences found
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 errors while checking
2024/11/07 01:19:15 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:15 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:15 INFO  : file1.txt: Winner cannot be determined as times are equal. Path1: 2003-07-23 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 0s
2024/11/07 01:19:15 INFO  : file1.txt: A winner could not be determined.
2024/11/07 01:19:15 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt.cloud1
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt.cloud1
2024/11/07 01:19:15 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt.cloud1
2024/11/07 01:19:15 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt.local1
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt.local1
2024/11/07 01:19:15 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt.local1
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : file1.txt.local1: Copied (new)
2024/11/07 01:19:15 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:15 INFO  : file1.txt.cloud1: Copied (new)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (32)  : test legacy
2024/11/07 01:19:15 NOTICE: (33)  : touch-glob 2004-07-23 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1R.txt
2024/11/07 01:19:15 NOTICE: (34)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file1.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:19:15 NOTICE: (35)  : touch-glob 2004-07-23 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1L.txt
2024/11/07 01:19:15 NOTICE: (36)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file1.txt
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:19:15 NOTICE: (37)  : test bisync run with --conflict-resolve=none --conflict-loser=pathname --conflict-suffix=.path
2024/11/07 01:19:15 NOTICE: (38)  : bisync conflict-resolve=none conflict-loser=pathname conflict-suffix=.path
2024/11/07 01:19:15 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:15 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:15 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:15 INFO  : Path1 checking for diffs
2024/11/07 01:19:15 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:19:15 INFO  : Path1:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:15 INFO  : Path2 checking for diffs
2024/11/07 01:19:15 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:19:15 INFO  : Path2:    1 changes:    1 new,    0 modified,    0 deleted
2024/11/07 01:19:15 INFO  : Applying changes
2024/11/07 01:19:15 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:15 INFO  : Checking potential conflicts...
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 differences found
2024/11/07 01:19:15 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 1 errors while checking
2024/11/07 01:19:15 INFO  : Finished checking the potential conflicts. 1 differences found
2024/11/07 01:19:15 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:15 NOTICE: - Path1    Renaming Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt..path1
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt..path1
2024/11/07 01:19:15 NOTICE: - Path1    Queue copy to Path2       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt..path1
2024/11/07 01:19:15 NOTICE: - Path2    Renaming Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt..path2
2024/11/07 01:19:15 INFO  : file1.txt: Moved (server-side) to: file1.txt..path2
2024/11/07 01:19:15 NOTICE: - Path2    Queue copy to Path1       - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file1.txt..path2
2024/11/07 01:19:15 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:15 INFO  : file1.txt..path2: Copied (new)
2024/11/07 01:19:15 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:15 INFO  : file1.txt..path1: Copied (new)
2024/11/07 01:19:15 INFO  : Updating listings
2024/11/07 01:19:15 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:15 INFO  : Bisync successful
2024/11/07 01:19:15 NOTICE: (39)  : test deletes on both sides with default suffix
2024/11/07 01:19:15 NOTICE: (40)  : touch-glob 2005-01-02 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1R.txt
2024/11/07 01:19:15 NOTICE: (41)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file1.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (new) to: file1.txt
2024/11/07 01:19:15 NOTICE: (42)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file2.txt
2024/11/07 01:19:15 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:15 NOTICE: (43)  : touch-glob 2006-03-04 /tmp/011859lo/datadir/test_resolve-wixezaf1/ file1L.txt
2024/11/07 01:19:15 NOTICE: (44)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path1/ file1.txt
2024/11/07 01:19:15 INFO  : file1L.txt: Copied (new) to: file1.txt
2024/11/07 01:19:15 NOTICE: (45)  : copy-as /tmp/011859lo/datadir/test_resolve-wixezaf1/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resolve/path2/ file2.txt
2024/11/07 01:19:16 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:16 NOTICE: (46)  : test bisync run with --conflict-resolve=newer --conflict-loser=delete
2024/11/07 01:19:16 NOTICE: (47)  : bisync conflict-resolve=newer conflict-loser=delete
2024/11/07 01:19:16 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:16 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:16 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:16 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:16 INFO  : Path1 checking for diffs
2024/11/07 01:19:16 INFO  : - Path1    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:16 INFO  : - Path1    File is new               - file1.txt
2024/11/07 01:19:16 INFO  : Path1:    2 changes:    1 new,    1 modified,    0 deleted
2024/11/07 01:19:16 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:16 INFO  : Path2 checking for diffs
2024/11/07 01:19:16 INFO  : - Path2    File changed: size (larger), time (newer) - file2.txt
2024/11/07 01:19:16 INFO  : - Path2    File is new               - file1.txt
2024/11/07 01:19:16 INFO  : Path2:    2 changes:    1 new,    1 modified,    0 deleted
2024/11/07 01:19:16 INFO  : (Modified:    1 newer,    0 older,    1 larger,    0 smaller)
2024/11/07 01:19:16 INFO  : Applying changes
2024/11/07 01:19:16 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:16 INFO  : Checking potential conflicts...
2024/11/07 01:19:16 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 2 differences found
2024/11/07 01:19:16 NOTICE: hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resolve/path2: 2 errors while checking
2024/11/07 01:19:16 INFO  : Finished checking the potential conflicts. 2 differences found
2024/11/07 01:19:16 NOTICE: - WARNING  New or changed in both paths       - file1.txt
2024/11/07 01:19:16 INFO  : file1.txt: Path1 is newer. Path1: 2006-03-04 00:00:00 +0000 UTC, Path2: 2005-01-02 00:00:00 +0000 UTC, Difference: 10224h0m0s
2024/11/07 01:19:16 INFO  : file1.txt: The winner is: Path1
2024/11/07 01:19:16 NOTICE: - Path2    Deleting Path2 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/file1.txt
2024/11/07 01:19:16 INFO  : file1.txt: Deleted
2024/11/07 01:19:16 INFO  : - Path1    Queue copy to Path2       - file1.txt
2024/11/07 01:19:16 NOTICE: - WARNING  New or changed in both paths       - file2.txt
2024/11/07 01:19:16 INFO  : file2.txt: Path2 is newer. Path1: 2005-01-02 00:00:00 +0000 UTC, Path2: 2006-03-04 00:00:00 +0000 UTC, Difference: 10224h0m0s
2024/11/07 01:19:16 INFO  : file2.txt: The winner is: Path2
2024/11/07 01:19:16 NOTICE: - Path1    Deleting Path1 copy                - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/file2.txt
2024/11/07 01:19:16 INFO  : file2.txt: Deleted
2024/11/07 01:19:16 INFO  : - Path2    Queue copy to Path1       - file2.txt
2024/11/07 01:19:16 INFO  : - Path2    Do queued copies to                - Path1
2024/11/07 01:19:16 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:16 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:16 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:16 INFO  : Updating listings
2024/11/07 01:19:16 INFO  : Can't compare hashes, so using check --download for safety. (Use --size-only or --ignore-checksum to disable)
2024/11/07 01:19:16 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resolve/path2/"
2024/11/07 01:19:16 INFO  : Bisync successful
    bisync_test.go:558: TEST resolve PASSED
=== RUN   TestBisyncRemoteRemote/resync
2024/11/07 01:19:16 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:16 DEBUG : path1: Making directory
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:16 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync/path1"
2024/11/07 01:19:16 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:16 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:16 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1"
2024/11/07 01:19:16 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:16 DEBUG : path2: Making directory
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:16 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync/path2"
2024/11/07 01:19:16 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:16 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:16 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:16 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:16 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2"
2024/11/07 01:19:16 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_resync-covuwid2"
2024/11/07 01:19:16 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : Local file system at /tmp/011859lo/initdir/test_resync-covuwid2: Waiting for checks to finish
2024/11/07 01:19:16 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:16 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : Local file system at /tmp/011859lo/initdir/test_resync-covuwid2: Waiting for transfers to finish
2024/11/07 01:19:16 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:16 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:16 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:16 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:16 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:16 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:16 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:16 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:16 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:16 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:16 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_resync-haquwac3"
2024/11/07 01:19:16 DEBUG : fileA.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : fileB.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : Local file system at /tmp/011859lo/datadir/test_resync-haquwac3: Waiting for checks to finish
2024/11/07 01:19:16 DEBUG : Local file system at /tmp/011859lo/datadir/test_resync-haquwac3: Waiting for transfers to finish
2024/11/07 01:19:16 DEBUG : fileA.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:16 DEBUG : fileA.txt.16ee54da.partial: renamed to: fileA.txt
2024/11/07 01:19:16 INFO  : fileA.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : fileB.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:16 DEBUG : fileB.txt.f0a2c6af.partial: renamed to: fileB.txt
2024/11/07 01:19:16 INFO  : fileB.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resync/path1]
2024/11/07 01:19:16 ERROR : : error listing: directory not found
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resync/path2]
2024/11/07 01:19:16 ERROR : : error listing: directory not found
2024/11/07 01:19:16 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_resync-covuwid2
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resync/path1]
2024/11/07 01:19:16 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: Waiting for checks to finish
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: Waiting for transfers to finish
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/RCLONE_TEST]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file2.txt]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file1.txt]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file3.txt]
2024/11/07 01:19:16 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file4.txt]
2024/11/07 01:19:16 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file5.txt]
2024/11/07 01:19:16 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file6.txt]
2024/11/07 01:19:16 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path1/file7.txt]
2024/11/07 01:19:16 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:16 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resync/path1]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resync/path2]
2024/11/07 01:19:16 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: Waiting for checks to finish
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/RCLONE_TEST]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file1.txt]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file2.txt]
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: Waiting for transfers to finish
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file3.txt]
2024/11/07 01:19:16 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file4.txt]
2024/11/07 01:19:16 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file5.txt]
2024/11/07 01:19:16 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file6.txt]
2024/11/07 01:19:16 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync/path2/file7.txt]
2024/11/07 01:19:16 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:16 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2
2024/11/07 01:19:16 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resync/path2]
2024/11/07 01:19:16 NOTICE: (01)  : test resync
2024/11/07 01:19:16 NOTICE: (02)  : test 1. resync with empty path1, resulting in copying all content from path2.
2024/11/07 01:19:16 NOTICE: (03)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path1/
2024/11/07 01:19:16 NOTICE: (04)  : bisync resync
2024/11/07 01:19:16 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:16 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:16 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:16 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:16 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:16 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:16 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:16 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:16 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:16 INFO  : Resync updating listings
2024/11/07 01:19:16 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:16 INFO  : Bisync successful
2024/11/07 01:19:16 NOTICE: (05)  : move-listings empty-path1
2024/11/07 01:19:16 NOTICE: (06)  : test 2. resync with empty path2, resulting in synching all content to path2.
2024/11/07 01:19:16 NOTICE: (07)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/
2024/11/07 01:19:16 NOTICE: (08)  : bisync resync
2024/11/07 01:19:16 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:16 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:16 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:16 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:16 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:16 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:16 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:16 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:16 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:16 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:16 INFO  : Resync updating listings
2024/11/07 01:19:16 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:16 INFO  : Bisync successful
2024/11/07 01:19:16 NOTICE: (09)  : move-listings empty-path2
2024/11/07 01:19:16 NOTICE: (10)  : test 3. exercise all of the various file difference scenarios during a resync.
2024/11/07 01:19:16 NOTICE: (11)  : touch-glob 2002-02-02 /tmp/011859lo/datadir/test_resync-haquwac3/ fileA.txt
2024/11/07 01:19:16 NOTICE: (12)  : touch-glob 1999-09-09 /tmp/011859lo/datadir/test_resync-haquwac3/ fileB.txt
2024/11/07 01:19:16 NOTICE: (13)  : test = file      - path1      - path2      - expected action    - who wins
2024/11/07 01:19:16 NOTICE: (14)  : test - file1.txt - exists     - missing    - sync path1 > path2 - path1
2024/11/07 01:19:16 NOTICE: (15)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/file1.txt
2024/11/07 01:19:16 INFO  : file1.txt: Deleted
2024/11/07 01:19:16 NOTICE: (16)  : test - file2.txt - missing    - exists     - copy path2 > path1 - path2
2024/11/07 01:19:16 NOTICE: (17)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path1/file2.txt
2024/11/07 01:19:16 INFO  : file2.txt: Deleted
2024/11/07 01:19:16 NOTICE: (18)  : test - file3.txt - exists     - newer date - sync path1 > path2 - path1
2024/11/07 01:19:16 NOTICE: (19)  : copy-as /tmp/011859lo/datadir/test_resync-haquwac3/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/ file3.txt
2024/11/07 01:19:16 INFO  : fileA.txt: Copied (replaced existing) to: file3.txt
2024/11/07 01:19:16 NOTICE: (20)  : test - file4.txt - missing    - newer date - copy path2 > path1 - path2
2024/11/07 01:19:16 NOTICE: (21)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path1/file4.txt
2024/11/07 01:19:16 INFO  : file4.txt: Deleted
2024/11/07 01:19:16 NOTICE: (22)  : copy-as /tmp/011859lo/datadir/test_resync-haquwac3/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/ file4.txt
2024/11/07 01:19:16 INFO  : fileA.txt: Copied (replaced existing) to: file4.txt
2024/11/07 01:19:16 NOTICE: (23)  : test - file5.txt - exists     - older date - sync path1 > path2 - path1
2024/11/07 01:19:16 NOTICE: (24)  : copy-as /tmp/011859lo/datadir/test_resync-haquwac3/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/ file5.txt
2024/11/07 01:19:17 INFO  : fileB.txt: Copied (replaced existing) to: file5.txt
2024/11/07 01:19:17 NOTICE: (25)  : test - file6.txt - older date - newer date - sync path1 > path2	- path1
2024/11/07 01:19:17 NOTICE: (26)  : copy-as /tmp/011859lo/datadir/test_resync-haquwac3/fileB.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path1/ file6.txt
2024/11/07 01:19:17 INFO  : fileB.txt: Copied (replaced existing) to: file6.txt
2024/11/07 01:19:17 NOTICE: (27)  : copy-as /tmp/011859lo/datadir/test_resync-haquwac3/fileA.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/ file6.txt
2024/11/07 01:19:17 INFO  : fileA.txt: Copied (replaced existing) to: file6.txt
2024/11/07 01:19:17 NOTICE: (28)  : test - file7.txt - exists     - exists (same) - none            - same
2024/11/07 01:19:17 NOTICE: (29)  : test run bisync with resync
2024/11/07 01:19:17 NOTICE: (30)  : bisync resync
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:17 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:17 INFO  : file5.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : file3.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : file6.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (31)  : copy-listings mixed-diffs
2024/11/07 01:19:17 NOTICE: (32)  : test run normal bisync
2024/11/07 01:19:17 NOTICE: (33)  : bisync
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:17 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:17 INFO  : Path1 checking for diffs
2024/11/07 01:19:17 INFO  : Path2 checking for diffs
2024/11/07 01:19:17 INFO  : No changes found
2024/11/07 01:19:17 INFO  : Updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (34)  : test 4. confirm critical error on normal sync of empty path.
2024/11/07 01:19:17 NOTICE: (35)  : purge-children TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync/path2/
2024/11/07 01:19:17 NOTICE: (36)  : bisync
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync/path2/"
2024/11/07 01:19:17 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:17 INFO  : Path1 checking for diffs
2024/11/07 01:19:17 INFO  : Path2 checking for diffs
2024/11/07 01:19:17 ERROR : Empty current Path2 listing. Cannot sync to an empty directory: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_resync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_resync_path2.path2.lst-new
2024/11/07 01:19:17 ERROR : Bisync critical error: empty current Path2 listing: /tmp/011859lo/workdir/TestHdfs_rclone-test-ruzotid9vaxo_011859lo_resync_path1..TestHdfs_rclone-test-ruzotid9vaxo_011859lo_resync_path2.path2.lst-new
2024/11/07 01:19:17 ERROR : Bisync aborted. Must run --resync to recover.
2024/11/07 01:19:17 NOTICE: Bisync error: bisync aborted
    bisync_test.go:558: TEST resync PASSED
=== RUN   TestBisyncRemoteRemote/resync_modes
2024/11/07 01:19:17 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:17 DEBUG : path1: Making directory
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:17 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1"
2024/11/07 01:19:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1"
2024/11/07 01:19:17 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:17 DEBUG : path2: Making directory
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:17 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2"
2024/11/07 01:19:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2"
2024/11/07 01:19:17 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_resync_modes-rasajem1"
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/initdir/test_resync_modes-rasajem1: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/initdir/test_resync_modes-rasajem1: Waiting for transfers to finish
2024/11/07 01:19:17 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:17 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:17 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:17 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:17 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:17 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_resync_modes-bihovex8"
2024/11/07 01:19:17 DEBUG : file1L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/datadir/test_resync_modes-bihovex8: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/datadir/test_resync_modes-bihovex8: Waiting for transfers to finish
2024/11/07 01:19:17 DEBUG : file2.txt: md5 = 9fe822ddd1cb81d83aae00fa48239bd3 OK
2024/11/07 01:19:17 DEBUG : file2.txt.7cc9b07.partial: renamed to: file2.txt
2024/11/07 01:19:17 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1L.txt: md5 = ea683c03f780b76a62405456b08ae6fd OK
2024/11/07 01:19:17 DEBUG : file1L.txt.7d07f91a.partial: renamed to: file1L.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1R.txt: md5 = 705bb3c0ef02925739e834ca98c099c3 OK
2024/11/07 01:19:17 DEBUG : file1R.txt.cb75035e.partial: renamed to: file1R.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1]
2024/11/07 01:19:17 ERROR : : error listing: directory not found
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2]
2024/11/07 01:19:17 ERROR : : error listing: directory not found
2024/11/07 01:19:17 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_resync_modes-rasajem1
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1]
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/RCLONE_TEST]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/file1.txt]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: update [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/file2.txt]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: Waiting for transfers to finish
2024/11/07 01:19:17 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:17 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:17 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:17 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1: list [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2]
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/file1.txt]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/RCLONE_TEST]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: Waiting for transfers to finish
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: update [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/file2.txt]
2024/11/07 01:19:17 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:17 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:17 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:17 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2: list [/rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2]
2024/11/07 01:19:17 NOTICE: (01)  : test resync-mode
2024/11/07 01:19:17 NOTICE: (02)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:17 NOTICE: (03)  : touch-glob 2001-01-02 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (04)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (05)  : touch-glob 2001-03-04 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (06)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (07)  : test bisync run with --resync-mode=newer
2024/11/07 01:19:17 NOTICE: (08)  : bisync resync resync-mode=newer
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (09)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:17 NOTICE: (10)  : touch-glob 2001-07-23 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (11)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (12)  : touch-glob 2001-08-26 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (13)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (14)  : test bisync run with --resync-mode=path2
2024/11/07 01:19:17 NOTICE: (15)  : bisync resync resync-mode=path2
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (16)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:17 NOTICE: (17)  : touch-glob 2002-07-23 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (18)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (19)  : touch-glob 2002-08-26 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (20)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (21)  : test bisync run with --resync-mode=larger
2024/11/07 01:19:17 NOTICE: (22)  : bisync resync resync-mode=larger
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : file1.txt: Path2 is larger. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (23)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:17 NOTICE: (24)  : touch-glob 2003-07-23 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (25)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (26)  : touch-glob 2003-09-04 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (27)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (28)  : test bisync run with --resync-mode=older
2024/11/07 01:19:17 NOTICE: (29)  : bisync resync resync-mode=older
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : file1.txt: Path2 is older. Path1: 2003-09-04 00:00:00 +0000 UTC, Path2: 2003-07-23 00:00:00 +0000 UTC, Difference: 1032h0m0s
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (30)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:17 NOTICE: (31)  : touch-glob 2004-07-23 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (32)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (33)  : touch-glob 2004-07-23 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (34)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (35)  : test bisync run with --resync-mode=smaller
2024/11/07 01:19:17 NOTICE: (36)  : bisync resync resync-mode=smaller
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : file1.txt: Path1 is smaller. Path1: 33, Path2: 42, Difference: 9
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (37)  : test changed on both paths and NOT identical - file1 (file1R, file1L)
2024/11/07 01:19:17 NOTICE: (38)  : touch-glob 2005-01-02 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (39)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (40)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file2.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:17 NOTICE: (41)  : touch-glob 2006-03-04 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (42)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (43)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file2.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:17 NOTICE: (44)  : test bisync run with --resync-mode=path1
2024/11/07 01:19:17 NOTICE: (45)  : bisync resync resync-mode=path1
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
2024/11/07 01:19:17 NOTICE: (46)  : test no winner
2024/11/07 01:19:17 NOTICE: (47)  : touch-glob 2022-02-22 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1R.txt
2024/11/07 01:19:17 NOTICE: (48)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file1.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (49)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1R.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file2.txt
2024/11/07 01:19:17 INFO  : file1R.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:17 NOTICE: (50)  : touch-glob 2022-02-22 /tmp/011859lo/datadir/test_resync_modes-bihovex8/ file1L.txt
2024/11/07 01:19:17 NOTICE: (51)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/ file1.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file1.txt
2024/11/07 01:19:17 NOTICE: (52)  : copy-as /tmp/011859lo/datadir/test_resync_modes-bihovex8/file1L.txt TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/ file2.txt
2024/11/07 01:19:17 INFO  : file1L.txt: Copied (replaced existing) to: file2.txt
2024/11/07 01:19:17 NOTICE: (53)  : test bisync run with --resync-mode=newer
2024/11/07 01:19:17 NOTICE: (54)  : bisync resync resync-mode=newer
2024/11/07 01:19:17 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:17 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:17 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:17 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:17 INFO  : file1.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : file2.txt: Copied (replaced existing)
2024/11/07 01:19:17 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:17 INFO  : Resync updating listings
2024/11/07 01:19:17 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/resync_modes/path2/"
2024/11/07 01:19:17 INFO  : Bisync successful
    bisync_test.go:558: TEST resync_modes PASSED
=== RUN   TestBisyncRemoteRemote/rmdirs
2024/11/07 01:19:17 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:17 DEBUG : path1: Making directory
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:17 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1"
2024/11/07 01:19:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1"
2024/11/07 01:19:17 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:17 DEBUG : path2: Making directory
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:17 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2"
2024/11/07 01:19:17 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:17 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:17 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:17 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2"
2024/11/07 01:19:17 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_rmdirs-fevekog4"
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : subdir: Making directory with metadata
2024/11/07 01:19:17 INFO  : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z)
2024/11/07 01:19:17 DEBUG : Added delayed dir = "subdir", newDst=subdir
2024/11/07 01:19:17 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/initdir/test_rmdirs-fevekog4: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/initdir/test_rmdirs-fevekog4: Waiting for transfers to finish
2024/11/07 01:19:17 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt
2024/11/07 01:19:17 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt
2024/11/07 01:19:17 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt
2024/11/07 01:19:17 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt
2024/11/07 01:19:17 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt
2024/11/07 01:19:17 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt
2024/11/07 01:19:17 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:17 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:17 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:17 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:17 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:17 INFO  : subdir: Set directory modification time (using SetModTime)
2024/11/07 01:19:17 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_rmdirs-tonugay0"
2024/11/07 01:19:17 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/datadir/test_rmdirs-tonugay0: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : Local file system at /tmp/011859lo/datadir/test_rmdirs-tonugay0: Waiting for transfers to finish
2024/11/07 01:19:17 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:17 DEBUG : file1.txt.13f42ab5.partial: renamed to: file1.txt
2024/11/07 01:19:17 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1]
2024/11/07 01:19:17 ERROR : : error listing: directory not found
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2]
2024/11/07 01:19:17 ERROR : : error listing: directory not found
2024/11/07 01:19:17 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_rmdirs-fevekog4
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1]
2024/11/07 01:19:17 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : subdir: Making directory
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: mkdir [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/subdir]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/RCLONE_TEST]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/file1.copy1.txt]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/file1.copy3.txt]
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/file1.copy2.txt]
2024/11/07 01:19:17 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: Waiting for checks to finish
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: Waiting for transfers to finish
2024/11/07 01:19:17 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/file1.copy4.txt]
2024/11/07 01:19:17 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:17 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/file1.copy5.txt]
2024/11/07 01:19:18 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/file1.txt]
2024/11/07 01:19:18 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/subdir/file20.txt]
2024/11/07 01:19:18 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:18 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:18 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/subdir]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2]
2024/11/07 01:19:18 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/RCLONE_TEST]
2024/11/07 01:19:18 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : subdir: Making directory
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/file1.copy2.txt]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: mkdir [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/subdir]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/file1.copy3.txt]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/file1.copy1.txt]
2024/11/07 01:19:18 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: Waiting for checks to finish
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: Waiting for transfers to finish
2024/11/07 01:19:18 INFO  : file1.copy2.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/file1.copy4.txt]
2024/11/07 01:19:18 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/file1.copy5.txt]
2024/11/07 01:19:18 INFO  : file1.copy3.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/file1.txt]
2024/11/07 01:19:18 INFO  : file1.copy1.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: update [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/subdir/file20.txt]
2024/11/07 01:19:18 INFO  : file1.copy4.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file1.copy5.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:18 INFO  : subdir/file20.txt: Copied (new)
2024/11/07 01:19:18 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2: list [/rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/subdir]
2024/11/07 01:19:18 NOTICE: (01)  : test rmdirs
2024/11/07 01:19:18 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:18 NOTICE: (03)  : bisync resync
2024/11/07 01:19:18 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:18 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:18 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/"
2024/11/07 01:19:18 INFO  : Copying Path2 files to Path1
2024/11/07 01:19:18 INFO  : - Path2    Resync is copying files to         - Path1
2024/11/07 01:19:18 INFO  : - Path1    Resync is copying files to         - Path2
2024/11/07 01:19:18 INFO  : Resync updating listings
2024/11/07 01:19:18 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/"
2024/11/07 01:19:18 INFO  : Bisync successful
2024/11/07 01:19:18 NOTICE: (04)  : test 1. delete path1 subdir file
2024/11/07 01:19:18 NOTICE: (05)  : delete-file TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/subdir/file20.txt
2024/11/07 01:19:18 INFO  : file20.txt: Deleted
2024/11/07 01:19:18 NOTICE: (06)  : test 2. run bisync without remove-empty-dirs
2024/11/07 01:19:18 NOTICE: (07)  : bisync
2024/11/07 01:19:18 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:18 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:18 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/"
2024/11/07 01:19:18 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:18 INFO  : Path1 checking for diffs
2024/11/07 01:19:18 INFO  : - Path1    File was deleted          - subdir/file20.txt
2024/11/07 01:19:18 INFO  : Path1:    1 changes:    0 new,    0 modified,    1 deleted
2024/11/07 01:19:18 INFO  : Path2 checking for diffs
2024/11/07 01:19:18 INFO  : Applying changes
2024/11/07 01:19:18 INFO  : - Path2    Queue delete              - TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/subdir/file20.txt
2024/11/07 01:19:18 INFO  : - Path1    Do queued copies to                - Path2
2024/11/07 01:19:18 INFO  : subdir/file20.txt: Deleted
2024/11/07 01:19:18 INFO  : Updating listings
2024/11/07 01:19:18 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/"
2024/11/07 01:19:18 INFO  : Bisync successful
2024/11/07 01:19:18 NOTICE: (08)  : test 3. confirm the subdir still exists on both paths
2024/11/07 01:19:18 NOTICE: (09)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/
2024/11/07 01:19:18 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:18 NOTICE: (10)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/
2024/11/07 01:19:18 NOTICE: subdir/ - filename hash: 86ae37b338459868804e9697025ba4c2
2024/11/07 01:19:18 NOTICE: (11)  : test 4. run bisync with remove-empty-dirs
2024/11/07 01:19:18 NOTICE: (12)  : bisync remove-empty-dirs
2024/11/07 01:19:18 INFO  : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set.
2024/11/07 01:19:18 INFO  : Bisyncing with Comparison Settings: 
{
	"Modtime": true,
	"Size": true,
	"Checksum": false,
	"HashType1": 0,
	"HashType2": 0,
	"NoSlowHash": false,
	"SlowHashSyncOnly": false,
	"SlowHashDetected": false,
	"DownloadHash": false
}
2024/11/07 01:19:18 INFO  : Synching Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/" with Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/"
2024/11/07 01:19:18 INFO  : Building Path1 and Path2 listings
2024/11/07 01:19:18 INFO  : Path1 checking for diffs
2024/11/07 01:19:18 INFO  : Path2 checking for diffs
2024/11/07 01:19:18 INFO  : No changes found
2024/11/07 01:19:18 INFO  : Updating listings
2024/11/07 01:19:18 INFO  : Validating listings for Path1 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/" vs Path2 "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/"
2024/11/07 01:19:18 INFO  : Removing empty directories
2024/11/07 01:19:18 INFO  : subdir: Removing directory
2024/11/07 01:19:18 INFO  : subdir: Removing directory
2024/11/07 01:19:18 INFO  : Bisync successful
2024/11/07 01:19:18 NOTICE: (13)  : test 5. confirm the subdir has been removed on both paths
2024/11/07 01:19:18 NOTICE: (14)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rmdirs/path1/
2024/11/07 01:19:18 NOTICE: (15)  : list-dirs TestHdfs,namenode='127.0.0.1:8020',username='root':rclone-test-ruzotid9vaxo/011859lo/rmdirs/path2/
    bisync_test.go:558: TEST rmdirs PASSED
=== RUN   TestBisyncRemoteRemote/volatile
2024/11/07 01:19:18 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:18 DEBUG : path1: Making directory
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path1]
2024/11/07 01:19:18 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/volatile/path1"
2024/11/07 01:19:18 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:18 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:18 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/volatile/path1" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/volatile/path1"
2024/11/07 01:19:18 DEBUG : fs cache: switching user supplied name "TestHdfs:rclone-test-ruzotid9vaxo/011859lo" for canonical name "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo"
2024/11/07 01:19:18 DEBUG : path2: Making directory
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo: mkdir [/rclone-test-ruzotid9vaxo/011859lo/path2]
2024/11/07 01:19:18 DEBUG : Creating backend with remote "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/volatile/path2"
2024/11/07 01:19:18 DEBUG : Setting type="hdfs" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_TYPE
2024/11/07 01:19:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:18 DEBUG : TestHdfs: detected overridden config - adding "{cNNQW}" suffix to name
2024/11/07 01:19:18 DEBUG : Setting namenode="127.0.0.1:8020" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_NAMENODE
2024/11/07 01:19:18 DEBUG : Setting username="root" for "TestHdfs" from environment variable RCLONE_CONFIG_TESTHDFS_USERNAME
2024/11/07 01:19:18 DEBUG : fs cache: renaming cache item "TestHdfs:rclone-test-ruzotid9vaxo/011859lo/volatile/path2" to be canonical "TestHdfs{cNNQW}:rclone-test-ruzotid9vaxo/011859lo/volatile/path2"
2024/11/07 01:19:18 DEBUG : Creating backend with remote "/tmp/011859lo/initdir/test_volatile-peyopuy4"
2024/11/07 01:19:18 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : Local file system at /tmp/011859lo/initdir/test_volatile-peyopuy4: Waiting for checks to finish
2024/11/07 01:19:18 DEBUG : Local file system at /tmp/011859lo/initdir/test_volatile-peyopuy4: Waiting for transfers to finish
2024/11/07 01:19:18 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt
2024/11/07 01:19:18 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt
2024/11/07 01:19:18 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt
2024/11/07 01:19:18 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt
2024/11/07 01:19:18 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt
2024/11/07 01:19:18 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt
2024/11/07 01:19:18 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt
2024/11/07 01:19:18 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file8.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : file8.txt.5028a97.partial: renamed to: file8.txt
2024/11/07 01:19:18 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK
2024/11/07 01:19:18 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST
2024/11/07 01:19:18 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:18 DEBUG : Creating backend with remote "/tmp/011859lo/datadir/test_volatile-sojocur2"
2024/11/07 01:19:18 DEBUG : dummy.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file10.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file11.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file5L.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file5R.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : Local file system at /tmp/011859lo/datadir/test_volatile-sojocur2: Waiting for checks to finish
2024/11/07 01:19:18 DEBUG : dummy.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK
2024/11/07 01:19:18 DEBUG : Local file system at /tmp/011859lo/datadir/test_volatile-sojocur2: Waiting for transfers to finish
2024/11/07 01:19:18 DEBUG : dummy.txt.75bafa33.partial: renamed to: dummy.txt
2024/11/07 01:19:18 INFO  : dummy.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file1.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:18 DEBUG : file1.txt.ae546193.partial: renamed to: file1.txt
2024/11/07 01:19:18 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file10.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:18 DEBUG : file10.txt.ae546193.partial: renamed to: file10.txt
2024/11/07 01:19:18 INFO  : file10.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file2.txt: md5 = fb3ecfb2800400fb01b0bfd39903e9fb OK
2024/11/07 01:19:18 DEBUG : file2.txt.8872da9c.partial: renamed to: file2.txt
2024/11/07 01:19:18 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file5L.txt: md5 = 0860a03592626642f8fd6c8bfb447d2a OK
2024/11/07 01:19:18 DEBUG : file11.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:18 DEBUG : file5L.txt.c32cc336.partial: renamed to: file5L.txt
2024/11/07 01:19:18 DEBUG : file11.txt.ae546193.partial: renamed to: file11.txt
2024/11/07 01:19:18 INFO  : file5L.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file11.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file5R.txt: md5 = 979a803b15d27df0c31ad7d29006d10b OK
2024/11/07 01:19:18 DEBUG : file5R.txt.aa998d0a.partial: renamed to: file5R.txt
2024/11/07 01:19:18 INFO  : file5R.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file6.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:18 DEBUG : file6.txt.ae546193.partial: renamed to: file6.txt
2024/11/07 01:19:18 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : file7.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK
2024/11/07 01:19:18 DEBUG : file7.txt.6bedbe24.partial: renamed to: file7.txt
2024/11/07 01:19:18 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: list [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1]
2024/11/07 01:19:18 ERROR : : error listing: directory not found
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: list [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2]
2024/11/07 01:19:18 ERROR : : error listing: directory not found
2024/11/07 01:19:18 NOTICE: checking initFs Local file system at /tmp/011859lo/initdir/test_volatile-peyopuy4
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: list [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1]
2024/11/07 01:19:18 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: Waiting for checks to finish
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: Waiting for transfers to finish
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/RCLONE_TEST]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file1.txt]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file2.txt]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file3.txt]
2024/11/07 01:19:18 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file4.txt]
2024/11/07 01:19:18 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file5.txt]
2024/11/07 01:19:18 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file6.txt]
2024/11/07 01:19:18 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file7.txt]
2024/11/07 01:19:18 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1/file8.txt]
2024/11/07 01:19:18 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:18 NOTICE: checking Path1 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path1: list [/rclone-test-ruzotid9vaxo/011859lo/volatile/path1]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: list [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2]
2024/11/07 01:19:18 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file1.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file2.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file3.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file4.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file5.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file6.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file7.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : file8.txt: Need to transfer - File not found at Destination
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file2.txt]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/RCLONE_TEST]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: Waiting for checks to finish
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: Waiting for transfers to finish
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file1.txt]
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file3.txt]
2024/11/07 01:19:18 INFO  : file2.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file4.txt]
2024/11/07 01:19:18 INFO  : file4.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file5.txt]
2024/11/07 01:19:18 INFO  : file1.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file6.txt]
2024/11/07 01:19:18 INFO  : file3.txt: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file7.txt]
2024/11/07 01:19:18 INFO  : RCLONE_TEST: Copied (new)
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: update [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2/file8.txt]
2024/11/07 01:19:18 INFO  : file5.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file6.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file7.txt: Copied (new)
2024/11/07 01:19:18 INFO  : file8.txt: Copied (new)
2024/11/07 01:19:18 NOTICE: checking path2 hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo/011859lo/volatile/path2: list [/rclone-test-ruzotid9vaxo/011859lo/volatile/path2]
2024/11/07 01:19:18 NOTICE: (01)  : test volatile
2024/11/07 01:19:18 NOTICE: (02)  : test initial bisync
2024/11/07 01:19:18 NOTICE: (03)  : bisync resync
    bisync_test.go:926: skipping 'volatile' test on non-local as it requires uploading 100 files
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo: Purge remote
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-ruzotid9vaxo: purge [/rclone-test-ruzotid9vaxo]
--- PASS: TestBisyncRemoteRemote (19.01s)
    --- PASS: TestBisyncRemoteRemote/all_changed (0.87s)
    --- SKIP: TestBisyncRemoteRemote/backupdir (0.37s)
    --- PASS: TestBisyncRemoteRemote/basic (0.49s)
    --- PASS: TestBisyncRemoteRemote/changes (0.75s)
    --- PASS: TestBisyncRemoteRemote/check_access (0.63s)
    --- PASS: TestBisyncRemoteRemote/check_access_filters (1.30s)
    --- PASS: TestBisyncRemoteRemote/check_filename (0.46s)
    --- PASS: TestBisyncRemoteRemote/check_sync (0.59s)
    --- PASS: TestBisyncRemoteRemote/compare_all (0.74s)
    --- PASS: TestBisyncRemoteRemote/createemptysrcdirs (0.77s)
    --- PASS: TestBisyncRemoteRemote/dry_run (0.78s)
    --- PASS: TestBisyncRemoteRemote/equal (0.27s)
    --- PASS: TestBisyncRemoteRemote/ext_paths (0.82s)
    --- PASS: TestBisyncRemoteRemote/extended_filenames (1.18s)
    --- PASS: TestBisyncRemoteRemote/filters (0.47s)
    --- PASS: TestBisyncRemoteRemote/filtersfile_checks (0.44s)
    --- PASS: TestBisyncRemoteRemote/ignorelistingchecksum (0.49s)
    --- PASS: TestBisyncRemoteRemote/max_delete_path1 (0.50s)
    --- PASS: TestBisyncRemoteRemote/max_delete_path2_force (0.48s)
    --- PASS: TestBisyncRemoteRemote/nomodtime (0.79s)
    --- PASS: TestBisyncRemoteRemote/normalization (1.63s)
    --- PASS: TestBisyncRemoteRemote/rclone_args (0.92s)
    --- PASS: TestBisyncRemoteRemote/resolve (0.77s)
    --- PASS: TestBisyncRemoteRemote/resync (1.02s)
    --- PASS: TestBisyncRemoteRemote/resync_modes (0.68s)
    --- PASS: TestBisyncRemoteRemote/rmdirs (0.45s)
    --- SKIP: TestBisyncRemoteRemote/volatile (0.36s)
PASS
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-balilof8moti: Purge remote
2024/11/07 01:19:18 DEBUG : hdfs://127.0.0.1:8020/rclone-test-balilof8moti: purge [/rclone-test-balilof8moti]
2024/11/07 01:19:18 NOTICE: purge failed: directory not found
"./bisync.test -test.v -test.timeout 1h0m0s -remote TestHdfs: -verbose" - Finished OK in 42.764697205s (try 1/5)