"./bisync.test -test.v -test.timeout 1h0m0s -remote TestS3Wasabi: -verbose -test.run '^TestBisyncRemoteRemote$/^filters$'" - Starting (try 2/5) 2024/10/02 03:30:00 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-zoqeteh0nuha" 2024/10/02 03:30:00 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/10/02 03:30:00 DEBUG : Creating backend with remote "/tmp/rclone2973442336" === RUN TestBisyncRemoteRemote 2024/10/02 03:30:00 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-vazaqos9tovo" 2024/10/02 03:30:00 NOTICE: remote: TestS3Wasabi:rclone-test-vazaqos9tovo === RUN TestBisyncRemoteRemote/filters 2024/10/02 03:30:00 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo" 2024/10/02 03:30:00 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/10/02 03:30:00 DEBUG : path1: Making directory 2024/10/02 03:30:01 INFO : S3 bucket rclone-test-vazaqos9tovo path 033000bo: Bucket "rclone-test-vazaqos9tovo" created with ACL "" 2024/10/02 03:30:01 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path1" 2024/10/02 03:30:01 DEBUG : path2: Making directory 2024/10/02 03:30:01 DEBUG : Creating backend with remote "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2" 2024/10/02 03:30:02 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/initial" 2024/10/02 03:30:02 DEBUG : Creating backend with remote "/tmp/033000bo/initdir/test_filters-lufileq1" 2024/10/02 03:30:02 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : subdir: Making directory with metadata 2024/10/02 03:30:02 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/10/02 03:30:02 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/10/02 03:30:02 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2024/10/02 03:30:02 INFO : file1.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : Local file system at /tmp/033000bo/initdir/test_filters-lufileq1: Waiting for checks to finish 2024/10/02 03:30:02 DEBUG : file2.txt.5028a97.partial: renamed to: file2.txt 2024/10/02 03:30:02 INFO : file2.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : Local file system at /tmp/033000bo/initdir/test_filters-lufileq1: Waiting for transfers to finish 2024/10/02 03:30:02 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/10/02 03:30:02 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : file5.txt.5028a97.partial: renamed to: file5.txt 2024/10/02 03:30:02 INFO : file5.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2024/10/02 03:30:02 INFO : RCLONE_TEST: Copied (new) 2024/10/02 03:30:02 DEBUG : file4.txt.5028a97.partial: renamed to: file4.txt 2024/10/02 03:30:02 INFO : file4.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : file6.txt.5028a97.partial: renamed to: file6.txt 2024/10/02 03:30:02 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 INFO : file6.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2024/10/02 03:30:02 INFO : subdir/file20.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:02 DEBUG : file7.txt.5028a97.partial: renamed to: file7.txt 2024/10/02 03:30:02 INFO : file7.txt: Copied (new) 2024/10/02 03:30:02 DEBUG : file3.txt.5028a97.partial: renamed to: file3.txt 2024/10/02 03:30:02 INFO : file3.txt: Copied (new) 2024/10/02 03:30:02 INFO : subdir: Set directory modification time (using SetModTime) 2024/10/02 03:30:02 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_filters/modfiles" 2024/10/02 03:30:02 DEBUG : Creating backend with remote "/tmp/033000bo/datadir/test_filters-fubeyuk1" 2024/10/02 03:30:02 DEBUG : fileZ.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : filtersfile.flt: Need to transfer - File not found at Destination 2024/10/02 03:30:02 DEBUG : Local file system at /tmp/033000bo/datadir/test_filters-fubeyuk1: Waiting for checks to finish 2024/10/02 03:30:02 DEBUG : Local file system at /tmp/033000bo/datadir/test_filters-fubeyuk1: Waiting for transfers to finish 2024/10/02 03:30:02 DEBUG : filtersfile.flt: md5 = 1cec24a8ae7c33c49693a14d53fd6a96 OK 2024/10/02 03:30:02 DEBUG : filtersfile.flt.9f8671d3.partial: renamed to: filtersfile.flt 2024/10/02 03:30:02 INFO : filtersfile.flt: Copied (new) 2024/10/02 03:30:02 DEBUG : fileZ.txt: md5 = 7fe98ed88552b828777d8630900346b8 OK 2024/10/02 03:30:02 DEBUG : fileZ.txt.925c801f.partial: renamed to: fileZ.txt 2024/10/02 03:30:02 INFO : fileZ.txt: Copied (new) 2024/10/02 03:30:03 NOTICE: checking initFs Local file system at /tmp/033000bo/initdir/test_filters-lufileq1 2024/10/02 03:30:03 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : subdir: Making directory 2024/10/02 03:30:03 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:03 DEBUG : S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path1: Waiting for checks to finish 2024/10/02 03:30:03 DEBUG : S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path1: Waiting for transfers to finish 2024/10/02 03:30:04 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file1.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file2.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file3.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/10/02 03:30:04 INFO : RCLONE_TEST: Copied (new) 2024/10/02 03:30:04 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file5.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file4.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file6.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : subdir/file20.txt: Copied (new) 2024/10/02 03:30:04 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:04 INFO : file7.txt: Copied (new) 2024/10/02 03:30:04 NOTICE: checking Path1 S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path1 2024/10/02 03:30:06 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file2.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file3.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file4.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file5.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file6.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : file7.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : subdir: Making directory 2024/10/02 03:30:06 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/10/02 03:30:06 DEBUG : S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path2: Waiting for checks to finish 2024/10/02 03:30:06 DEBUG : S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path2: Waiting for transfers to finish 2024/10/02 03:30:06 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/10/02 03:30:06 INFO : RCLONE_TEST: Copied (new) 2024/10/02 03:30:07 DEBUG : file3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file3.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file1.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : file2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file2.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : file4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file4.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : file6.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file6.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : file5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file5.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : file7.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : file7.txt: Copied (new) 2024/10/02 03:30:07 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/10/02 03:30:07 INFO : subdir/file20.txt: Copied (new) 2024/10/02 03:30:07 NOTICE: checking path2 S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path2 2024/10/02 03:30:09 NOTICE: (01) : test filters 2024/10/02 03:30:09 NOTICE: (02) : copy-file /tmp/033000bo/datadir/test_filters-fubeyuk1/filtersfile.flt /tmp/033000bo/workdir/ 2024/10/02 03:30:09 INFO : filtersfile.flt: Copied (new) 2024/10/02 03:30:09 NOTICE: (03) : test resync to force building of the filters md5 hash 2024/10/02 03:30:09 NOTICE: (04) : bisync filters-file=/tmp/033000bo/workdir/filtersfile.flt resync 2024/10/02 03:30:11 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/10/02 03:30:11 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/10/02 03:30:11 INFO : Synching Path1 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path1/" with Path2 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2/" 2024/10/02 03:30:11 INFO : Using filters file /tmp/033000bo/workdir/filtersfile.flt 2024/10/02 03:30:11 INFO : Storing filters file hash to /tmp/033000bo/workdir/filtersfile.flt.md5 2024/10/02 03:30:11 INFO : Copying Path2 files to Path1 2024/10/02 03:30:11 INFO : - Path2 Resync is copying files to - Path1 2024/10/02 03:30:16 INFO : - Path1 Resync is copying files to - Path2 2024/10/02 03:30:17 INFO : Resync updating listings 2024/10/02 03:30:17 INFO : Validating listings for Path1 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path1/" vs Path2 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2/" 2024/10/02 03:30:17 INFO : Bisync successful 2024/10/02 03:30:17 NOTICE: (05) : copy-listings resync 2024/10/02 03:30:17 NOTICE: (06) : test place new files on the remote 2024/10/02 03:30:17 NOTICE: (07) : touch-glob 2001-01-02 /tmp/033000bo/datadir/test_filters-fubeyuk1/ fileZ.txt 2024/10/02 03:30:17 NOTICE: (08) : copy-as /tmp/033000bo/datadir/test_filters-fubeyuk1/fileZ.txt TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2/ fileZ.txt 2024/10/02 03:30:18 INFO : S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path2: Bucket "rclone-test-vazaqos9tovo" created with ACL "" 2024/10/02 03:30:18 INFO : fileZ.txt: Copied (new) 2024/10/02 03:30:18 NOTICE: (09) : copy-as /tmp/033000bo/datadir/test_filters-fubeyuk1/fileZ.txt TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path1/subdir fileZ.txt 2024/10/02 03:30:19 INFO : S3 bucket rclone-test-vazaqos9tovo path 033000bo/filters/path1/subdir: Bucket "rclone-test-vazaqos9tovo" created with ACL "" 2024/10/02 03:30:20 INFO : fileZ.txt: Copied (new) 2024/10/02 03:30:20 NOTICE: (10) : test bisync with filters-file. path2-side fileZ.txt will be filtered. 2024/10/02 03:30:20 NOTICE: (11) : bisync filters-file=/tmp/033000bo/workdir/filtersfile.flt 2024/10/02 03:30:21 INFO : Setting --ignore-listing-checksum as neither --checksum nor --compare checksum are set. 2024/10/02 03:30:21 INFO : Bisyncing with Comparison Settings: { "Modtime": true, "Size": true, "Checksum": false, "HashType1": 0, "HashType2": 0, "NoSlowHash": false, "SlowHashSyncOnly": false, "SlowHashDetected": false, "DownloadHash": false } 2024/10/02 03:30:21 INFO : Synching Path1 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path1/" with Path2 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2/" 2024/10/02 03:30:21 INFO : Using filters file /tmp/033000bo/workdir/filtersfile.flt 2024/10/02 03:30:21 INFO : Building Path1 and Path2 listings 2024/10/02 03:30:24 INFO : Path1 checking for diffs 2024/10/02 03:30:24 INFO : - Path1 File is new - subdir/fileZ.txt 2024/10/02 03:30:24 INFO : Path1: 1 changes:  1 new,  0 modified,  0 deleted 2024/10/02 03:30:24 INFO : Path2 checking for diffs 2024/10/02 03:30:24 INFO : Applying changes 2024/10/02 03:30:24 INFO : - Path1 Queue copy to Path2 - TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2/subdir/fileZ.txt 2024/10/02 03:30:24 INFO : - Path1 Do queued copies to - Path2 2024/10/02 03:30:25 INFO : subdir/fileZ.txt: Copied (server-side copy) 2024/10/02 03:30:25 INFO : Updating listings 2024/10/02 03:30:25 INFO : Validating listings for Path1 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path1/" vs Path2 "TestS3Wasabi:rclone-test-vazaqos9tovo/033000bo/filters/path2/" 2024/10/02 03:30:25 INFO : Bisync successful bisync_test.go:558: TEST filters PASSED 2024/10/02 03:30:28 DEBUG : S3 bucket rclone-test-vazaqos9tovo: Purge remote 2024/10/02 03:30:29 DEBUG : S3 bucket rclone-test-vazaqos9tovo: bucket is versioned: false 2024/10/02 03:30:29 DEBUG : Waiting for deletions to finish 2024/10/02 03:30:29 INFO : S3 bucket rclone-test-vazaqos9tovo: Bucket "rclone-test-vazaqos9tovo" deleted --- PASS: TestBisyncRemoteRemote (29.95s) --- PASS: TestBisyncRemoteRemote/filters (28.63s) PASS 2024/10/02 03:30:29 DEBUG : S3 bucket rclone-test-zoqeteh0nuha: Purge remote 2024/10/02 03:30:30 ERROR : S3 bucket rclone-test-zoqeteh0nuha: Failed to read versioning status, assuming unversioned: operation error S3: GetBucketVersioning, https response error StatusCode: 404, RequestID: 6317BB3D5C1138C8:A, HostID: m1PXD2MjIx7i4cj2ug8uMGp/Mus8jBmYkHnYU0UmhTVhSZy64oHh6Yd18Y60dO9ZSN6H6DpttRYx, api error NoSuchBucket: The specified bucket does not exist 2024/10/02 03:30:30 DEBUG : S3 bucket rclone-test-zoqeteh0nuha: bucket is versioned: false 2024/10/02 03:30:30 DEBUG : Waiting for deletions to finish 2024/10/02 03:30:30 NOTICE: purge failed: directory not found "./bisync.test -test.v -test.timeout 1h0m0s -remote TestS3Wasabi: -verbose -test.run '^TestBisyncRemoteRemote$/^filters$'" - Finished OK in 30.998247214s (try 2/5)