"./bisync.test -test.v -test.timeout 1h0m0s -remote TestS3R2: -verbose -test.run '^TestBisyncRemoteRemote$/^check_filename$'" - Starting (try 2/5) 2024/11/05 03:04:59 DEBUG : Creating backend with remote "TestS3R2:rclone-test-veguyit1zoni" 2024/11/05 03:04:59 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/05 03:04:59 DEBUG : Creating backend with remote "/tmp/rclone3745782144" === RUN TestBisyncRemoteRemote 2024/11/05 03:04:59 DEBUG : Creating backend with remote "TestS3R2:rclone-test-hisokal1xoci" 2024/11/05 03:04:59 NOTICE: remote: TestS3R2:rclone-test-hisokal1xoci === RUN TestBisyncRemoteRemote/check_filename 2024/11/05 03:04:59 DEBUG : Creating backend with remote "TestS3R2:rclone-test-hisokal1xoci/030459du" 2024/11/05 03:04:59 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/05 03:04:59 DEBUG : path1: Making directory 2024/11/05 03:05:00 INFO : S3 bucket rclone-test-hisokal1xoci path 030459du: Bucket "rclone-test-hisokal1xoci" created with ACL "" 2024/11/05 03:05:00 DEBUG : Creating backend with remote "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1" 2024/11/05 03:05:00 DEBUG : path2: Making directory 2024/11/05 03:05:00 DEBUG : Creating backend with remote "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2" 2024/11/05 03:05:00 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/initial" 2024/11/05 03:05:00 DEBUG : Creating backend with remote "/tmp/030459du/initdir/test_check_filename-jubudeh9" 2024/11/05 03:05:00 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : subdir: Making directory with metadata 2024/11/05 03:05:00 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/11/05 03:05:00 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/11/05 03:05:00 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:00 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2024/11/05 03:05:00 INFO : file1.txt: Copied (new) 2024/11/05 03:05:00 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:00 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2024/11/05 03:05:00 INFO : file2.txt: Copied (new) 2024/11/05 03:05:00 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:00 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2024/11/05 03:05:00 INFO : file3.txt: Copied (new) 2024/11/05 03:05:00 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:00 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2024/11/05 03:05:00 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:00 INFO : file4.txt: Copied (new) 2024/11/05 03:05:00 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/05 03:05:00 DEBUG : .chk_file.cf9a93ac.partial: renamed to: .chk_file 2024/11/05 03:05:00 INFO : .chk_file: Copied (new) 2024/11/05 03:05:00 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:00 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2024/11/05 03:05:00 INFO : subdir/file20.txt: Copied (new) 2024/11/05 03:05:00 DEBUG : Local file system at /tmp/030459du/initdir/test_check_filename-jubudeh9: Waiting for checks to finish 2024/11/05 03:05:00 DEBUG : Local file system at /tmp/030459du/initdir/test_check_filename-jubudeh9: Waiting for transfers to finish 2024/11/05 03:05:00 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/05 03:05:00 DEBUG : subdir/.chk_file.cf9a93ac.partial: renamed to: subdir/.chk_file 2024/11/05 03:05:00 INFO : subdir/.chk_file: Copied (new) 2024/11/05 03:05:00 INFO : subdir: Set directory modification time (using SetModTime) 2024/11/05 03:05:00 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_check_filename/modfiles" 2024/11/05 03:05:00 DEBUG : Creating backend with remote "/tmp/030459du/datadir/test_check_filename-basosur6" 2024/11/05 03:05:00 DEBUG : hold.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:00 DEBUG : Local file system at /tmp/030459du/datadir/test_check_filename-basosur6: Waiting for checks to finish 2024/11/05 03:05:00 DEBUG : Local file system at /tmp/030459du/datadir/test_check_filename-basosur6: Waiting for transfers to finish 2024/11/05 03:05:00 DEBUG : hold.txt: md5 = 628c2241b6ba4e313ef08bdfcf1cd964 OK 2024/11/05 03:05:00 DEBUG : hold.txt.627e309f.partial: renamed to: hold.txt 2024/11/05 03:05:00 INFO : hold.txt: Copied (new) 2024/11/05 03:05:01 NOTICE: checking initFs Local file system at /tmp/030459du/initdir/test_check_filename-jubudeh9 2024/11/05 03:05:01 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : subdir: Making directory 2024/11/05 03:05:01 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:01 DEBUG : S3 bucket rclone-test-hisokal1xoci path 030459du/check_filename/path1: Waiting for checks to finish 2024/11/05 03:05:01 DEBUG : S3 bucket rclone-test-hisokal1xoci path 030459du/check_filename/path1: Waiting for transfers to finish 2024/11/05 03:05:01 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:01 INFO : file3.txt: Copied (new) 2024/11/05 03:05:01 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:01 INFO : file2.txt: Copied (new) 2024/11/05 03:05:01 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:01 INFO : file1.txt: Copied (new) 2024/11/05 03:05:01 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:01 INFO : file4.txt: Copied (new) 2024/11/05 03:05:01 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/05 03:05:01 INFO : .chk_file: Copied (new) 2024/11/05 03:05:01 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:01 INFO : subdir/file20.txt: Copied (new) 2024/11/05 03:05:01 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/05 03:05:01 INFO : subdir/.chk_file: Copied (new) 2024/11/05 03:05:01 NOTICE: checking Path1 S3 bucket rclone-test-hisokal1xoci path 030459du/check_filename/path1 2024/11/05 03:05:02 DEBUG : .chk_file: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : subdir: Making directory 2024/11/05 03:05:02 DEBUG : subdir/.chk_file: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/11/05 03:05:02 DEBUG : S3 bucket rclone-test-hisokal1xoci path 030459du/check_filename/path2: Waiting for checks to finish 2024/11/05 03:05:02 DEBUG : S3 bucket rclone-test-hisokal1xoci path 030459du/check_filename/path2: Waiting for transfers to finish 2024/11/05 03:05:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:02 INFO : file1.txt: Copied (new) 2024/11/05 03:05:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:02 INFO : file3.txt: Copied (new) 2024/11/05 03:05:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:02 INFO : file2.txt: Copied (new) 2024/11/05 03:05:02 DEBUG : .chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/05 03:05:02 INFO : .chk_file: Copied (new) 2024/11/05 03:05:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:02 INFO : file4.txt: Copied (new) 2024/11/05 03:05:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/05 03:05:02 INFO : subdir/file20.txt: Copied (new) 2024/11/05 03:05:02 DEBUG : subdir/.chk_file: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/05 03:05:02 INFO : subdir/.chk_file: Copied (new) 2024/11/05 03:05:02 NOTICE: checking path2 S3 bucket rclone-test-hisokal1xoci path 030459du/check_filename/path2 2024/11/05 03:05:03 NOTICE: (01) : test check-filename 2024/11/05 03:05:03 NOTICE: (02) : test initial bisync 2024/11/05 03:05:03 NOTICE: (03) : bisync resync 2024/11/05 03:05:04 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/11/05 03:05:04 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/11/05 03:05:04 INFO : Synching Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" with Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:04 INFO : Copying Path2 files to Path1 2024/11/05 03:05:04 INFO : - Path2 Resync is copying files to - Path1 2024/11/05 03:05:04 INFO : - Path1 Resync is copying files to - Path2 2024/11/05 03:05:05 INFO : Resync updating listings 2024/11/05 03:05:05 INFO : Validating listings for Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" vs Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:05 INFO : Bisync successful 2024/11/05 03:05:05 NOTICE: (04) : test 1. see that check-access passes with the initial setup 2024/11/05 03:05:05 NOTICE: (05) : bisync check-access check-filename=.chk_file 2024/11/05 03:05:06 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/11/05 03:05:06 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/11/05 03:05:06 INFO : Synching Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" with Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:06 INFO : Building Path1 and Path2 listings 2024/11/05 03:05:07 INFO : Path1 checking for diffs 2024/11/05 03:05:07 INFO : Path2 checking for diffs 2024/11/05 03:05:07 INFO : Checking access health 2024/11/05 03:05:07 INFO : Found 2 matching ".chk_file" files on both paths 2024/11/05 03:05:07 INFO : No changes found 2024/11/05 03:05:07 INFO : Updating listings 2024/11/05 03:05:07 INFO : Validating listings for Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" vs Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:07 INFO : Bisync successful 2024/11/05 03:05:07 NOTICE: (06) : copy-listings initial-pass 2024/11/05 03:05:07 NOTICE: (07) : test 2. delete the remote subdir .chk_file, run sync. should fail critical. 2024/11/05 03:05:07 NOTICE: (08) : delete-file TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/subdir/.chk_file 2024/11/05 03:05:07 INFO : .chk_file: Deleted 2024/11/05 03:05:07 NOTICE: (09) : bisync check-access check-filename=.chk_file 2024/11/05 03:05:07 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/11/05 03:05:07 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/11/05 03:05:07 INFO : Synching Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" with Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:07 INFO : Building Path1 and Path2 listings 2024/11/05 03:05:08 INFO : Path1 checking for diffs 2024/11/05 03:05:08 INFO : Path2 checking for diffs 2024/11/05 03:05:08 INFO : - Path2 File was deleted - subdir/.chk_file 2024/11/05 03:05:08 INFO : Path2: 1 changes:  0 new,  0 modified,  1 deleted 2024/11/05 03:05:08 INFO : Checking access health 2024/11/05 03:05:08 ERROR : Access test failed: Path1 count 2, Path2 count 1 - .chk_file 2024/11/05 03:05:08 ERROR : -  Access test failed: Path1 file not found in Path2 - subdir/.chk_file 2024/11/05 03:05:08 ERROR : Bisync critical error: check file check failed 2024/11/05 03:05:08 ERROR : Bisync aborted. Must run --resync to recover. 2024/11/05 03:05:08 NOTICE: Bisync error: bisync aborted 2024/11/05 03:05:08 NOTICE: (10) : move-listings path2-missing 2024/11/05 03:05:08 NOTICE: (11) : test 3. put the remote subdir .chk_file back, run resync. 2024/11/05 03:05:08 NOTICE: (12) : copy-file TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/subdir/.chk_file TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/subdir/ 2024/11/05 03:05:09 INFO : .chk_file: Copied (server-side copy) 2024/11/05 03:05:09 NOTICE: (13) : bisync check-access resync check-filename=.chk_file 2024/11/05 03:05:10 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/11/05 03:05:10 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/11/05 03:05:10 INFO : Synching Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" with Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:10 INFO : Copying Path2 files to Path1 2024/11/05 03:05:10 INFO : Checking access health 2024/11/05 03:05:11 INFO : Found 2 matching ".chk_file" files on both paths 2024/11/05 03:05:11 INFO : - Path2 Resync is copying files to - Path1 2024/11/05 03:05:11 INFO : - Path1 Resync is copying files to - Path2 2024/11/05 03:05:12 INFO : Resync updating listings 2024/11/05 03:05:12 INFO : Validating listings for Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" vs Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:12 INFO : Bisync successful 2024/11/05 03:05:12 NOTICE: (14) : test 4. run sync with check-access. should pass. 2024/11/05 03:05:12 NOTICE: (15) : bisync check-access check-filename=.chk_file 2024/11/05 03:05:13 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/11/05 03:05:13 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/11/05 03:05:13 INFO : Synching Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" with Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:13 INFO : Building Path1 and Path2 listings 2024/11/05 03:05:13 INFO : Path1 checking for diffs 2024/11/05 03:05:13 INFO : Path2 checking for diffs 2024/11/05 03:05:13 INFO : Checking access health 2024/11/05 03:05:13 INFO : Found 2 matching ".chk_file" files on both paths 2024/11/05 03:05:13 INFO : No changes found 2024/11/05 03:05:13 INFO : Updating listings 2024/11/05 03:05:13 INFO : Validating listings for Path1 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path1/" vs Path2 "TestS3R2:rclone-test-hisokal1xoci/030459du/check_filename/path2/" 2024/11/05 03:05:13 INFO : Bisync successful bisync_test.go:558: TEST check_filename PASSED 2024/11/05 03:05:14 DEBUG : S3 bucket rclone-test-hisokal1xoci: Purge remote 2024/11/05 03:05:14 DEBUG : S3 bucket rclone-test-hisokal1xoci: bucket is versioned: false 2024/11/05 03:05:14 DEBUG : Waiting for deletions to finish 2024/11/05 03:05:15 INFO : S3 bucket rclone-test-hisokal1xoci: Bucket "rclone-test-hisokal1xoci" deleted --- PASS: TestBisyncRemoteRemote (15.66s) --- PASS: TestBisyncRemoteRemote/check_filename (14.64s) PASS 2024/11/05 03:05:15 DEBUG : S3 bucket rclone-test-veguyit1zoni: Purge remote 2024/11/05 03:05:15 ERROR : S3 bucket rclone-test-veguyit1zoni: Failed to read versioning status, assuming unversioned: operation error S3: GetBucketVersioning, https response error StatusCode: 404, RequestID: , HostID: , api error NoSuchBucket: The specified bucket does not exist. 2024/11/05 03:05:15 DEBUG : S3 bucket rclone-test-veguyit1zoni: bucket is versioned: false 2024/11/05 03:05:15 DEBUG : Waiting for deletions to finish 2024/11/05 03:05:16 NOTICE: purge failed: directory not found "./bisync.test -test.v -test.timeout 1h0m0s -remote TestS3R2: -verbose -test.run '^TestBisyncRemoteRemote$/^check_filename$'" - Finished OK in 16.459436974s (try 2/5)