"./bisync.test -test.v -test.timeout 1h0m0s -remote TestCompressS3: -verbose -test.run '^TestBisyncRemoteRemote$/^all_changed$'" - Starting (try 2/5) 2025/05/06 04:01:07 DEBUG : Creating backend with remote "TestCompressS3:rclone-test-kukoguk7zulo" 2025/05/06 04:01:07 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/05/06 04:01:07 DEBUG : Creating backend with remote "/tmp/rclone1388856485" === RUN TestBisyncRemoteRemote 2025/05/06 04:01:07 DEBUG : Creating backend with remote "TestCompressS3:rclone-test-valugit7jahu" 2025/05/06 04:01:07 NOTICE: remote: TestCompressS3:rclone-test-valugit7jahu === RUN TestBisyncRemoteRemote/all_changed 2025/05/06 04:01:07 DEBUG : Creating backend with remote "TestCompressS3:rclone-test-valugit7jahu/040107na" 2025/05/06 04:01:07 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/05/06 04:01:07 INFO : path1: Making directory 2025/05/06 04:01:08 INFO : S3 bucket rclone-test-valugit7jahu path 040107na: Bucket "rclone-test-valugit7jahu" created with ACL "" 2025/05/06 04:01:08 DEBUG : Creating backend with remote "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1" 2025/05/06 04:01:08 INFO : path2: Making directory 2025/05/06 04:01:08 DEBUG : Creating backend with remote "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2" 2025/05/06 04:01:08 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_all_changed/initial" 2025/05/06 04:01:08 DEBUG : Creating backend with remote "/tmp/040107na/initdir/test_all_changed-tupojin5" 2025/05/06 04:01:08 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : subdir: Making directory with metadata 2025/05/06 04:01:08 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2025/05/06 04:01:08 DEBUG : Added delayed dir = "subdir", newDst=subdir 2025/05/06 04:01:08 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2025/05/06 04:01:08 INFO : file1.copy1.txt: Copied (new) 2025/05/06 04:01:08 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2025/05/06 04:01:08 INFO : file1.copy4.txt: Copied (new) 2025/05/06 04:01:08 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2025/05/06 04:01:08 INFO : file1.copy2.txt: Copied (new) 2025/05/06 04:01:08 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:08 DEBUG : Local file system at /tmp/040107na/initdir/test_all_changed-tupojin5: Waiting for checks to finish 2025/05/06 04:01:08 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : Local file system at /tmp/040107na/initdir/test_all_changed-tupojin5: Waiting for transfers to finish 2025/05/06 04:01:08 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2025/05/06 04:01:08 INFO : file1.copy5.txt: Copied (new) 2025/05/06 04:01:08 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/05/06 04:01:08 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2025/05/06 04:01:08 INFO : file1.txt: Copied (new) 2025/05/06 04:01:08 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2025/05/06 04:01:08 INFO : RCLONE_TEST: Copied (new) 2025/05/06 04:01:08 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:08 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2025/05/06 04:01:08 INFO : file1.copy3.txt: Copied (new) 2025/05/06 04:01:08 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2025/05/06 04:01:08 INFO : subdir/file20.txt: Copied (new) 2025/05/06 04:01:08 INFO : subdir: Set directory modification time (using SetModTime) 2025/05/06 04:01:09 NOTICE: checking initFs Local file system at /tmp/040107na/initdir/test_all_changed-tupojin5 2025/05/06 04:01:09 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 INFO : subdir: Making directory 2025/05/06 04:01:09 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:09 DEBUG : Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1: Waiting for checks to finish 2025/05/06 04:01:09 DEBUG : Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1: Waiting for transfers to finish 2025/05/06 04:01:09 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : file1.copy1.txt: Copied (new) 2025/05/06 04:01:09 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : file1.copy2.txt: Copied (new) 2025/05/06 04:01:09 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : file1.copy3.txt: Copied (new) 2025/05/06 04:01:09 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/05/06 04:01:09 INFO : RCLONE_TEST: Copied (new) 2025/05/06 04:01:09 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : file1.copy5.txt: Copied (new) 2025/05/06 04:01:09 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : file1.copy4.txt: Copied (new) 2025/05/06 04:01:09 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : file1.txt: Copied (new) 2025/05/06 04:01:09 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:09 INFO : subdir/file20.txt: Copied (new) 2025/05/06 04:01:09 NOTICE: checking Path1 Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1 2025/05/06 04:01:10 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : file1.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 INFO : subdir: Making directory 2025/05/06 04:01:10 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2025/05/06 04:01:10 DEBUG : Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2: Waiting for checks to finish 2025/05/06 04:01:10 DEBUG : Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2: Waiting for transfers to finish 2025/05/06 04:01:11 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2025/05/06 04:01:11 INFO : RCLONE_TEST: Copied (new) 2025/05/06 04:01:11 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : file1.copy2.txt: Copied (new) 2025/05/06 04:01:11 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : file1.copy3.txt: Copied (new) 2025/05/06 04:01:11 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : file1.copy1.txt: Copied (new) 2025/05/06 04:01:11 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : file1.copy4.txt: Copied (new) 2025/05/06 04:01:11 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : file1.copy5.txt: Copied (new) 2025/05/06 04:01:11 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : file1.txt: Copied (new) 2025/05/06 04:01:11 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2025/05/06 04:01:11 INFO : subdir/file20.txt: Copied (new) 2025/05/06 04:01:11 NOTICE: checking path2 Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2 2025/05/06 04:01:12 NOTICE: (01) : test all-changed 2025/05/06 04:01:12 NOTICE: (02) : test initial bisync 2025/05/06 04:01:12 NOTICE: (03) : bisync resync 2025/05/06 04:01:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/05/06 04:01:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/05/06 04:01:13 INFO : Synching Path1 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/" with Path2 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/" 2025/05/06 04:01:13 INFO : Copying Path2 files to Path1 2025/05/06 04:01:13 INFO : - Path2 Resync is copying files to - Path1 2025/05/06 04:01:13 INFO : - Path1 Resync is copying files to - Path2 2025/05/06 04:01:14 INFO : Resync updating listings 2025/05/06 04:01:14 INFO : Validating listings for Path1 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/" vs Path2 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/" 2025/05/06 04:01:14 INFO : Bisync successful 2025/05/06 04:01:14 NOTICE: (04) : test change timestamp on all files except RCLONE_TEST 2025/05/06 04:01:14 NOTICE: (05) : touch-glob 2005-01-02 TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/ file* 2025/05/06 04:01:14 NOTICE: (06) : touch-glob 2005-01-02 TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/subdir file* 2025/05/06 04:01:15 NOTICE: (07) : test sync should pass 2025/05/06 04:01:15 NOTICE: (08) : bisync 2025/05/06 04:01:16 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/05/06 04:01:16 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/05/06 04:01:16 INFO : Synching Path1 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/" with Path2 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/" 2025/05/06 04:01:16 INFO : Building Path1 and Path2 listings 2025/05/06 04:01:16 INFO : Path1 checking for diffs 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - file1.copy1.txt 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - file1.copy2.txt 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - file1.copy3.txt 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - file1.copy4.txt 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - file1.copy5.txt 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - file1.txt 2025/05/06 04:01:16 INFO : - Path1 File changed: time (newer) - subdir/file20.txt 2025/05/06 04:01:16 INFO : Path1: 7 changes:  0 new,  7 modified,  0 deleted 2025/05/06 04:01:16 INFO : (Modified:  7 newer,  0 older) 2025/05/06 04:01:16 INFO : Path2 checking for diffs 2025/05/06 04:01:16 INFO : Applying changes 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/file1.copy1.txt 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/file1.copy2.txt 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/file1.copy3.txt 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/file1.copy4.txt 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/file1.copy5.txt 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/file1.txt 2025/05/06 04:01:16 INFO : - Path1 Queue copy to Path2 - TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/subdir/file20.txt 2025/05/06 04:01:16 INFO : - Path1 Do queued copies to - Path2 2025/05/06 04:01:16 NOTICE: file1.txt.bin: Failed to read metadata: object not found 2025/05/06 04:01:17 ERROR : subdir/file20.txt: Failed to calculate src hash: object not found 2025/05/06 04:01:17 ERROR : subdir/file20.txt: Failed to calculate dst hash: operation error S3: HeadObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context canceled 2025/05/06 04:01:17 INFO : file1.txt: Updated modification time in destination 2025/05/06 04:01:17 INFO : file1.copy1.txt: Updated modification time in destination 2025/05/06 04:01:17 INFO : file1.copy2.txt: Updated modification time in destination 2025/05/06 04:01:17 INFO : file1.copy4.txt: Updated modification time in destination 2025/05/06 04:01:17 INFO : file1.copy3.txt: Updated modification time in destination 2025/05/06 04:01:17 INFO : file1.copy5.txt: Updated modification time in destination 2025/05/06 04:01:17 INFO : subdir/file20.txt: Copied (server-side copy) 2025/05/06 04:01:17 ERROR : Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2: not deleting files as there were IO errors 2025/05/06 04:01:17 ERROR : Compressed: TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2: not deleting directories as there were IO errors 2025/05/06 04:01:17 ERROR : Bisync critical error: not deleting files as there were IO errors 2025/05/06 04:01:17 ERROR : Bisync aborted. Must run --resync to recover. 2025/05/06 04:01:17 NOTICE: Bisync error: bisync aborted 2025/05/06 04:01:17 NOTICE: (09) : test change timestamp on all files including RCLONE_TEST 2025/05/06 04:01:17 NOTICE: (10) : touch-glob 2004-01-02 TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/ * 2025/05/06 04:01:18 NOTICE: (11) : touch-glob 2004-01-02 TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/subdir * 2025/05/06 04:01:18 NOTICE: (12) : test sync should fail 2025/05/06 04:01:18 NOTICE: (13) : bisync 2025/05/06 04:01:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/05/06 04:01:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/05/06 04:01:19 INFO : Synching Path1 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/" with Path2 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/" 2025/05/06 04:01:19 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/040107na/workdir/TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path1..TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path2.path1.lst Path2: /tmp/040107na/workdir/TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path1..TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/040107na/workdir" 2025/05/06 04:01:19 ERROR : Bisync aborted. Must run --resync to recover. 2025/05/06 04:01:19 NOTICE: Bisync error: bisync aborted 2025/05/06 04:01:19 NOTICE: (14) : test sync with force should pass 2025/05/06 04:01:19 NOTICE: (15) : bisync force 2025/05/06 04:01:19 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2025/05/06 04:01:19 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2025/05/06 04:01:19 INFO : Synching Path1 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path1/" with Path2 "TestCompressS3:rclone-test-valugit7jahu/040107na/all_changed/path2/" 2025/05/06 04:01:19 ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run Tip: here are the filenames we were looking for. Do they exist? Path1: /tmp/040107na/workdir/TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path1..TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path2.path1.lst Path2: /tmp/040107na/workdir/TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path1..TestCompressS3_rclone-test-valugit7jahu_040107na_all_changed_path2.path2.lst Try running this command to inspect the work dir: rclone lsl "/tmp/040107na/workdir" 2025/05/06 04:01:19 ERROR : Bisync aborted. Must run --resync to recover. 2025/05/06 04:01:19 NOTICE: Bisync error: bisync aborted 2025/05/06 04:01:19 NOTICE: ---------------------------------------------------------- 2025/05/06 04:01:19 NOTICE: MISCOMPARE - Number of Golden and Results files do not match: 2025/05/06 04:01:19 NOTICE: Golden count: 8 2025/05/06 04:01:19 NOTICE: Result count: 6 2025/05/06 04:01:19 NOTICE: Golden files: _testdir_path1.._testdir_path2.copy1to2.que, _testdir_path1.._testdir_path2.path1.lst, _testdir_path1.._testdir_path2.path1.lst-new, _testdir_path1.._testdir_path2.path1.lst-old, _testdir_path1.._testdir_path2.path2.lst, _testdir_path1.._testdir_path2.path2.lst-new, _testdir_path1.._testdir_path2.path2.lst-old, test.log 2025/05/06 04:01:19 NOTICE: Result files: _testdir_path1.._testdir_path2.copy1to2.que, _testdir_path1.._testdir_path2.path1.lst-err, _testdir_path1.._testdir_path2.path1.lst-new, _testdir_path1.._testdir_path2.path2.lst-err, _testdir_path1.._testdir_path2.path2.lst-new, test.log 2025/05/06 04:01:19 NOTICE: File found in Golden but not in Results: _testdir_path1.._testdir_path2.path1.lst 2025/05/06 04:01:19 NOTICE: File found in Golden but not in Results: _testdir_path1.._testdir_path2.path1.lst-old 2025/05/06 04:01:19 NOTICE: File found in Golden but not in Results: _testdir_path1.._testdir_path2.path2.lst 2025/05/06 04:01:19 NOTICE: File found in Golden but not in Results: _testdir_path1.._testdir_path2.path2.lst-old 2025/05/06 04:01:19 NOTICE: File found in Results but not in Golden: _testdir_path1.._testdir_path2.path1.lst-err 2025/05/06 04:01:19 NOTICE: File found in Results but not in Golden: _testdir_path1.._testdir_path2.path2.lst-err 2025/05/06 04:01:19 NOTICE: ---------------------------------------------------------- 2025/05/06 04:01:19 NOTICE: | MISCOMPARE -Golden vs +Results for _testdir_path1.._testdir_path2.copy1to2.que 2025/05/06 04:01:19 NOTICE: | @@ -1 +0,0 @@ 2025/05/06 04:01:19 NOTICE: | -"RCLONE_TEST" 2025/05/06 04:01:19 NOTICE: ---------------------------------------------------------- 2025/05/06 04:01:19 NOTICE: | MISCOMPARE -Golden vs +Results for _testdir_path1.._testdir_path2.path1.lst-new 2025/05/06 04:01:19 NOTICE: | @@ -1 +1 @@ 2025/05/06 04:01:19 NOTICE: | -- 109 - - 2004-01-02 00:00:00 +0000 UTC "\"RCLONE_TEST\"" 2025/05/06 04:01:19 NOTICE: | +- 109 - - 2000-01-01 00:00:00 +0000 UTC "\"RCLONE_TEST\"" 2025/05/06 04:01:19 NOTICE: | @@ -3 +3 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"file1.copy1.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy1.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -5 +5 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"file1.copy2.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy2.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -7 +7 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"file1.copy3.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy3.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -9 +9 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"file1.copy4.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy4.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -11 +11 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"file1.copy5.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy5.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -13 +13 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"file1.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -15 +15 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2004-01-02 00:00:00 +0000 UTC "\"subdir/file20.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"subdir/file20.txt\"" 2025/05/06 04:01:19 NOTICE: ---------------------------------------------------------- 2025/05/06 04:01:19 NOTICE: | MISCOMPARE -Golden vs +Results for _testdir_path1.._testdir_path2.path2.lst-new 2025/05/06 04:01:19 NOTICE: | @@ -3 +3 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy1.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"file1.copy1.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -5 +5 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy2.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"file1.copy2.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -7 +7 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy3.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"file1.copy3.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -9 +9 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy4.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"file1.copy4.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -11 +11 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.copy5.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"file1.copy5.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -13 +13 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"file1.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"file1.txt\"" 2025/05/06 04:01:19 NOTICE: | @@ -15 +15 @@ 2025/05/06 04:01:19 NOTICE: | -- 0 - - 2005-01-02 00:00:00 +0000 UTC "\"subdir/file20.txt\"" 2025/05/06 04:01:19 NOTICE: | +- 0 - - 2000-01-01 00:00:00 +0000 UTC "\"subdir/file20.txt\"" 2025/05/06 04:01:20 NOTICE: ---------------------------------------------------------- 2025/05/06 04:01:20 NOTICE: | MISCOMPARE -Golden vs +Results for test.log 2025/05/06 04:01:20 NOTICE: | @@ -58,3 +58,8 @@ 2025/05/06 04:01:20 NOTICE: | -INFO : Updating listings 2025/05/06 04:01:20 NOTICE: | -INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}" 2025/05/06 04:01:20 NOTICE: | -INFO : Bisync successful 2025/05/06 04:01:20 NOTICE: | +NOTICE: file1.txt.bin: Failed to read metadata: object not found 2025/05/06 04:01:20 NOTICE: | +ERROR : subdir/file20.txt: Failed to calculate src hash: object not found 2025/05/06 04:01:20 NOTICE: | +ERROR : subdir/file20.txt: Failed to calculate dst hash: operation error S3: HeadObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context canceled 2025/05/06 04:01:20 NOTICE: | +ERROR : {path2String}: not deleting files as there were IO errors 2025/05/06 04:01:20 NOTICE: | +ERROR : {path2String}: not deleting directories as there were IO errors 2025/05/06 04:01:20 NOTICE: | +ERROR : Bisync critical error: not deleting files as there were IO errors 2025/05/06 04:01:20 NOTICE: | +ERROR : Bisync aborted. Must run --resync to recover. 2025/05/06 04:01:20 NOTICE: | +Bisync error: bisync aborted 2025/05/06 04:01:20 NOTICE: | @@ -77,16 +82,8 @@ 2025/05/06 04:01:20 NOTICE: | -INFO : Building Path1 and Path2 listings 2025/05/06 04:01:20 NOTICE: | -INFO : Path1 checking for diffs 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/05/06 04:01:20 NOTICE: | -INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/05/06 04:01:20 NOTICE: | -INFO : (Modified:  1 newer,  7 older) 2025/05/06 04:01:20 NOTICE: | -INFO : Path2 checking for diffs 2025/05/06 04:01:20 NOTICE: | -ERROR : Safety abort: all files were changed on Path1 "{path1/}". Run with --force if desired. 2025/05/06 04:01:20 NOTICE: | -NOTICE: Bisync aborted. Please try again. 2025/05/06 04:01:20 NOTICE: | -Bisync error: all files were changed 2025/05/06 04:01:20 NOTICE: | +ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 2025/05/06 04:01:20 NOTICE: | +Tip: here are the filenames we were looking for. Do they exist? 2025/05/06 04:01:20 NOTICE: | +Path1: {workdir/}{session}.path1.lst 2025/05/06 04:01:20 NOTICE: | +Path2: {workdir/}{session}.path2.lst 2025/05/06 04:01:20 NOTICE: | +Try running this command to inspect the work dir: 2025/05/06 04:01:20 NOTICE: | +rclone lsl "{workdir}" 2025/05/06 04:01:20 NOTICE: | +ERROR : Bisync aborted. Must run --resync to recover. 2025/05/06 04:01:20 NOTICE: | +Bisync error: bisync aborted 2025/05/06 04:01:20 NOTICE: | @@ -106,26 +103,8 @@ 2025/05/06 04:01:20 NOTICE: | -INFO : Building Path1 and Path2 listings 2025/05/06 04:01:20 NOTICE: | -INFO : Path1 checking for diffs 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (newer) - RCLONE_TEST 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy1.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy2.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy3.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy4.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.copy5.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - file1.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 File changed: time (older) - subdir/file20.txt 2025/05/06 04:01:20 NOTICE: | -INFO : Path1: 8 changes:  0 new,  8 modified,  0 deleted 2025/05/06 04:01:20 NOTICE: | -INFO : (Modified:  1 newer,  7 older) 2025/05/06 04:01:20 NOTICE: | -INFO : Path2 checking for diffs 2025/05/06 04:01:20 NOTICE: | -INFO : Applying changes 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}RCLONE_TEST 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}file1.copy1.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}file1.copy2.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}file1.copy3.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}file1.copy4.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}file1.copy5.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}file1.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Queue copy to Path2 - {path2/}subdir/file20.txt 2025/05/06 04:01:20 NOTICE: | -INFO : - Path1 Do queued copies to - Path2 2025/05/06 04:01:20 NOTICE: | -INFO : Updating listings 2025/05/06 04:01:20 NOTICE: | -INFO : Validating listings for Path1 "{path1/}" vs Path2 "{path2/}" 2025/05/06 04:01:20 NOTICE: | -INFO : Bisync successful 2025/05/06 04:01:20 NOTICE: | +ERROR : Bisync critical error: cannot find prior Path1 or Path2 listings, likely due to critical error on prior run 2025/05/06 04:01:20 NOTICE: | +Tip: here are the filenames we were looking for. Do they exist? 2025/05/06 04:01:20 NOTICE: | +Path1: {workdir/}{session}.path1.lst 2025/05/06 04:01:20 NOTICE: | +Path2: {workdir/}{session}.path2.lst 2025/05/06 04:01:20 NOTICE: | +Try running this command to inspect the work dir: 2025/05/06 04:01:20 NOTICE: | +rclone lsl "{workdir}" 2025/05/06 04:01:20 NOTICE: | +ERROR : Bisync aborted. Must run --resync to recover. 2025/05/06 04:01:20 NOTICE: | +Bisync error: bisync aborted 2025/05/06 04:01:20 NOTICE: ---------------------------------------------------------- bisync_test.go:560: TEST all_changed FAILED - 10 MISCOMPARED FILES 2025/05/06 04:01:20 DEBUG : Compressed: TestCompressS3:rclone-test-valugit7jahu: Purge remote 2025/05/06 04:01:20 DEBUG : S3 bucket rclone-test-valugit7jahu: bucket is versioned: false 2025/05/06 04:01:20 DEBUG : Waiting for deletions to finish 2025/05/06 04:01:20 INFO : S3 bucket rclone-test-valugit7jahu: Bucket "rclone-test-valugit7jahu" deleted --- FAIL: TestBisyncRemoteRemote (13.40s) --- FAIL: TestBisyncRemoteRemote/all_changed (12.92s) FAIL 2025/05/06 04:01:20 DEBUG : Compressed: TestCompressS3:rclone-test-kukoguk7zulo: Purge remote 2025/05/06 04:01:20 ERROR : S3 bucket rclone-test-kukoguk7zulo: Failed to read versioning status, assuming unversioned: operation error S3: GetBucketVersioning, https response error StatusCode: 404, RequestID: 2J0T6XJ9NHTYEHEE, HostID: GlR2tpAzz2+4AUznpuq1iuXe7LyfCCuMbXyjZ1Dg3xMsKwagdcLSj5WgCU0iaLhWxBMeIdEHodI=, api error NoSuchBucket: The specified bucket does not exist 2025/05/06 04:01:20 DEBUG : S3 bucket rclone-test-kukoguk7zulo: bucket is versioned: false 2025/05/06 04:01:20 DEBUG : Waiting for deletions to finish 2025/05/06 04:01:21 NOTICE: purge failed: directory not found "./bisync.test -test.v -test.timeout 1h0m0s -remote TestCompressS3: -verbose -test.run '^TestBisyncRemoteRemote$/^all_changed$'" - Finished ERROR in 13.709845289s (try 2/5): exit status 1: Failed [TestBisyncRemoteRemote/all_changed]