"./bisync.test -test.v -test.timeout 1h0m0s -remote TestKoofr: -verbose" - Starting (try 5/5) 2024/11/09 05:10:46 DEBUG : Creating backend with remote "TestKoofr:rclone-test-wugapij6cagi" 2024/11/09 05:10:46 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/09 05:10:46 DEBUG : Creating backend with remote "/tmp/rclone1511081765" === RUN TestBisyncRemoteLocal 2024/11/09 05:10:46 DEBUG : Creating backend with remote "TestKoofr:rclone-test-tutojem8fece" 2024/11/09 05:10:47 NOTICE: remote: TestKoofr:rclone-test-tutojem8fece === RUN TestBisyncRemoteLocal/all_changed 2024/11/09 05:10:47 DEBUG : Creating backend with remote "TestKoofr:rclone-test-tutojem8fece/051047va" 2024/11/09 05:10:47 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/09 05:10:47 DEBUG : path1: Making directory 2024/11/09 05:10:48 DEBUG : Creating backend with remote "TestKoofr:rclone-test-tutojem8fece/051047va/all_changed/path1" 2024/11/09 05:10:48 DEBUG : Creating backend with remote "/tmp/051047va" 2024/11/09 05:10:48 DEBUG : Creating backend with remote "/tmp/051047va/all_changed/path2" 2024/11/09 05:10:48 DEBUG : Creating backend with remote "/home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/testdata/test_all_changed/initial" 2024/11/09 05:10:48 DEBUG : Creating backend with remote "/tmp/051047va/initdir/test_all_changed-felonop0" 2024/11/09 05:10:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : subdir: Making directory with metadata 2024/11/09 05:10:48 INFO : subdir: Made directory with metadata (mtime=2021-11-02T05:00:07Z) 2024/11/09 05:10:48 DEBUG : Added delayed dir = "subdir", newDst=subdir 2024/11/09 05:10:48 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy2.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 DEBUG : file1.copy2.txt.5028a97.partial: renamed to: file1.copy2.txt 2024/11/09 05:10:48 INFO : file1.copy2.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : file1.copy1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 DEBUG : file1.copy1.txt.5028a97.partial: renamed to: file1.copy1.txt 2024/11/09 05:10:48 DEBUG : file1.copy4.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 INFO : file1.copy1.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : file1.copy3.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 DEBUG : file1.copy4.txt.5028a97.partial: renamed to: file1.copy4.txt 2024/11/09 05:10:48 INFO : file1.copy4.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : Local file system at /tmp/051047va/initdir/test_all_changed-felonop0: Waiting for checks to finish 2024/11/09 05:10:48 DEBUG : Local file system at /tmp/051047va/initdir/test_all_changed-felonop0: Waiting for transfers to finish 2024/11/09 05:10:48 DEBUG : RCLONE_TEST: md5 = 294d25b294ff26a5243dba914ac3fbf7 OK 2024/11/09 05:10:48 DEBUG : file1.copy3.txt.5028a97.partial: renamed to: file1.copy3.txt 2024/11/09 05:10:48 INFO : file1.copy3.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : file1.copy5.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 DEBUG : file1.copy5.txt.5028a97.partial: renamed to: file1.copy5.txt 2024/11/09 05:10:48 INFO : file1.copy5.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : subdir/file20.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 DEBUG : subdir/file20.txt.5028a97.partial: renamed to: subdir/file20.txt 2024/11/09 05:10:48 INFO : subdir/file20.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : file1.txt: md5 = d41d8cd98f00b204e9800998ecf8427e OK 2024/11/09 05:10:48 DEBUG : file1.txt.5028a97.partial: renamed to: file1.txt 2024/11/09 05:10:48 INFO : file1.txt: Copied (new) 2024/11/09 05:10:48 DEBUG : RCLONE_TEST.cf9a93ac.partial: renamed to: RCLONE_TEST 2024/11/09 05:10:48 INFO : RCLONE_TEST: Copied (new) 2024/11/09 05:10:48 INFO : subdir: Set directory modification time (using SetModTime) 2024/11/09 05:10:48 ERROR : : error listing: directory not found 2024/11/09 05:10:48 ERROR : : error listing: directory not found 2024/11/09 05:10:48 NOTICE: checking initFs Local file system at /tmp/051047va/initdir/test_all_changed-felonop0 2024/11/09 05:10:48 DEBUG : file1.copy1.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy2.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy3.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy4.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.copy5.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : file1.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : RCLONE_TEST: Need to transfer - File not found at Destination 2024/11/09 05:10:48 DEBUG : subdir: Making directory 2024/11/09 05:10:49 DEBUG : subdir/file20.txt: Need to transfer - File not found at Destination 2024/11/09 05:10:49 DEBUG : koofr:4266cdc3-3d29-4a88-ac94-738914c162b4:rclone-test-tutojem8fece/051047va/all_changed/path1: Waiting for checks to finish 2024/11/09 05:10:49 DEBUG : koofr:4266cdc3-3d29-4a88-ac94-738914c162b4:rclone-test-tutojem8fece/051047va/all_changed/path1: Waiting for transfers to finish 2024/11/09 05:15:49 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 05:15:49 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 05:15:49 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 05:15:49 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 05:20:49 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 1/10 2024/11/09 05:20:49 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 1/10 2024/11/09 05:20:49 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 1/10 2024/11/09 05:20:49 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 1/10 2024/11/09 05:25:49 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 2/10 2024/11/09 05:25:49 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 2/10 2024/11/09 05:25:49 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 2/10 2024/11/09 05:25:49 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 2/10 2024/11/09 05:30:50 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 3/10 2024/11/09 05:30:50 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 3/10 2024/11/09 05:30:50 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 3/10 2024/11/09 05:30:50 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 3/10 2024/11/09 05:35:50 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 4/10 2024/11/09 05:35:50 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 4/10 2024/11/09 05:35:50 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 4/10 2024/11/09 05:35:50 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 4/10 2024/11/09 05:40:51 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 5/10 2024/11/09 05:40:51 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 5/10 2024/11/09 05:40:51 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 5/10 2024/11/09 05:40:51 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 5/10 2024/11/09 05:45:51 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 6/10 2024/11/09 05:45:51 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 6/10 2024/11/09 05:45:51 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 6/10 2024/11/09 05:45:51 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 6/10 2024/11/09 05:50:51 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 7/10 2024/11/09 05:50:51 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 7/10 2024/11/09 05:50:51 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 7/10 2024/11/09 05:50:51 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 7/10 2024/11/09 05:55:51 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 8/10 2024/11/09 05:55:51 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 8/10 2024/11/09 05:55:51 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 8/10 2024/11/09 05:55:51 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 8/10 2024/11/09 06:00:51 DEBUG : file1.copy2.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 9/10 2024/11/09 06:00:51 ERROR : file1.copy2.txt: Failed to copy: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy2.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers 2024/11/09 06:00:52 DEBUG : file1.copy3.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 9/10 2024/11/09 06:00:52 ERROR : file1.copy3.txt: Failed to copy: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy3.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers 2024/11/09 06:00:52 DEBUG : file1.copy1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 9/10 2024/11/09 06:00:52 ERROR : file1.copy1.txt: Failed to copy: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers 2024/11/09 06:00:52 DEBUG : file1.copy4.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 9/10 2024/11/09 06:00:52 ERROR : file1.copy4.txt: Failed to copy: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy4.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers 2024/11/09 06:05:52 DEBUG : file1.copy5.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.copy5.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 06:05:52 DEBUG : RCLONE_TEST: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=RCLONE_TEST&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 06:05:52 DEBUG : file1.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file1.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1": http2: timeout awaiting response headers - low level retry 0/10 2024/11/09 06:05:52 DEBUG : subdir/file20.txt: Received error: Post "https:/content/api/v2/mounts/4266cdc3-3d29-4a88-ac94-738914c162b4/files/put?autorename=false&filename=file20.txt&info=true&modified=946684800000&overwrite=true&overwriteIgnoreNonexisting=&path=%2Frclone-test-tutojem8fece%2F051047va%2Fall_changed%2Fpath1%2Fsubdir": http2: timeout awaiting response headers - low level retry 0/10 panic: test timed out after 1h0m0s running tests: TestBisyncRemoteLocal (1h0m0s) TestBisyncRemoteLocal/all_changed (1h0m0s) goroutine 693 [running]: testing.(*M).startAlarm.func1() /usr/local/go/src/testing/testing.go:2366 +0x385 created by time.goFunc /usr/local/go/src/time/sleep.go:177 +0x2d goroutine 1 [chan receive, 60 minutes]: testing.(*T).Run(0xc00052c4e0, {0x23b3122?, 0x0?}, 0x24db240) /usr/local/go/src/testing/testing.go:1750 +0x3ab testing.runTests.func1(0xc00052c4e0) /usr/local/go/src/testing/testing.go:2161 +0x37 testing.tRunner(0xc00052c4e0, 0xc0008bdc00) /usr/local/go/src/testing/testing.go:1689 +0xfb testing.runTests(0xc0005fe2d0, {0x3947b60, 0x3, 0x3}, {0x1?, 0xedec0e5d6?, 0x3984d20?}) /usr/local/go/src/testing/testing.go:2159 +0x445 testing.(*M).Run(0xc0004297c0) /usr/local/go/src/testing/testing.go:2027 +0x68b github.com/rclone/rclone/fstest.TestMain(0xc0004297c0) /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:69 +0xa5 github.com/rclone/rclone/cmd/bisync_test.TestMain(...) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:227 main.main() _testmain.go:55 +0x196 goroutine 23 [syscall, 60 minutes]: os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f goroutine 671 [chan receive, 5 minutes]: github.com/rclone/rclone/backend/local.(*fadvise).worker(0xc0004c8100) /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:114 +0x3f created by github.com/rclone/rclone/backend/local.newFadvise in goroutine 329 /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:74 +0x11f goroutine 8 [select]: go.opencensus.io/stats/view.(*worker).start(0xc000311580) /home/rclone/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f created by go.opencensus.io/stats/view.init.0 in goroutine 1 /home/rclone/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d goroutine 666 [select]: github.com/rclone/rclone/fs/accounting.(*Account).averageLoop(0xc000541600) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:221 +0xf6 created by github.com/rclone/rclone/fs/accounting.newAccountSizeName in goroutine 328 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:119 +0x438 goroutine 24 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 1 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xab goroutine 67 [chan receive, 60 minutes]: testing.(*T).Run(0xc00052c680, {0xc000523a15?, 0x275dec0?}, 0xc000112ff0) /usr/local/go/src/testing/testing.go:1750 +0x3ab github.com/rclone/rclone/cmd/bisync_test.testBisync(0xc00052c680, {0xc000593bf0, 0x22}, {0x0, 0x0}) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:349 +0x967 github.com/rclone/rclone/cmd/bisync_test.TestBisyncRemoteLocal(0xc00052c680) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:239 +0x16a testing.tRunner(0xc00052c680, 0x24db240) /usr/local/go/src/testing/testing.go:1689 +0xfb created by testing.(*T).Run in goroutine 1 /usr/local/go/src/testing/testing.go:1742 +0x390 goroutine 74 [chan receive, 60 minutes]: github.com/rclone/rclone/lib/atexit.Register.func1.1() /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:45 +0x29 created by github.com/rclone/rclone/lib/atexit.Register.func1 in goroutine 67 /home/rclone/go/src/github.com/rclone/rclone/lib/atexit/atexit.go:44 +0x68 goroutine 82 [chan receive, 60 minutes]: github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1() /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27 created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 67 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xab goroutine 75 [semacquire, 59 minutes]: sync.runtime_Semacquire(0x0?) /usr/local/go/src/runtime/sema.go:62 +0x25 sync.(*WaitGroup).Wait(0xc0006c1707?) /usr/local/go/src/sync/waitgroup.go:116 +0x48 github.com/rclone/rclone/fs/sync.(*syncCopyMove).stopTransfers(0xc000548a08) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:539 +0x75 github.com/rclone/rclone/fs/sync.(*syncCopyMove).run(0xc000548a08) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:974 +0x332 github.com/rclone/rclone/fs/sync.runSyncCopyMove({0x2791b88, 0xc0006171d0}, {0x27a6600, 0xc0006185a0}, {0x27a67c0, 0xc000618dc0}, 0x0, 0x0, 0x0, 0x1) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:1361 +0x20e github.com/rclone/rclone/fs/sync.CopyDir(...) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:1372 github.com/rclone/rclone/cmd/bisync_test.(*bisyncTest).runTestCase(0xc000155500, {0x2791ae0, 0x39e8120}, 0x603?, {0xc000523a15?, 0x32efab0?}) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:456 +0xed9 github.com/rclone/rclone/cmd/bisync_test.testBisync.func4(0xc00052c9c0) /home/rclone/go/src/github.com/rclone/rclone/cmd/bisync/bisync_test.go:356 +0x225 testing.tRunner(0xc00052c9c0, 0xc000112ff0) /usr/local/go/src/testing/testing.go:1689 +0xfb created by testing.(*T).Run in goroutine 67 /usr/local/go/src/testing/testing.go:1742 +0x390 goroutine 326 [select, 5 minutes]: net/http.(*http2ClientConn).RoundTrip(0xc000716000, 0xc0006ae6c0) /usr/local/go/src/net/http/h2_bundle.go:8323 +0x434 net/http.(*http2Transport).RoundTripOpt(0xc000584fc0, 0xc0006ae6c0, {0xda?}) /usr/local/go/src/net/http/h2_bundle.go:7591 +0x1b1 net/http.(*http2Transport).RoundTrip(...) /usr/local/go/src/net/http/h2_bundle.go:7540 net/http.http2noDialH2RoundTripper.RoundTrip({0xc0002597c0?}, 0xc0006ae6c0?) /usr/local/go/src/net/http/h2_bundle.go:10167 +0x1a net/http.(*Transport).roundTrip(0xc0002597c0, 0xc0006ae5a0) /usr/local/go/src/net/http/transport.go:553 +0x39c net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:17 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0005ad650, 0xc0006ae5a0) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:352 +0x345 net/http.send(0xc0006ae5a0, {0x276dd00, 0xc0005ad650}, {0x1?, 0x8?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e4 net/http.(*Client).send(0xc0006b2900, 0xc0006ae5a0, {0x413fdb?, 0x160?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x98 net/http.(*Client).do(0xc0006b2900, 0xc0006ae5a0) /usr/local/go/src/net/http/client.go:724 +0x8dc net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:590 github.com/koofr/go-httpclient.(*HTTPClient).Request(0xc000113c70, 0xc00065b6a0) /home/rclone/go/pkg/mod/github.com/koofr/go-httpclient@v0.0.0-20240520111329-e20f8f203988/httpclient.go:346 +0x505 github.com/koofr/go-koofrclient.(*KoofrClient).FilesPutWithOptions(0xc0006b2930, {0xc000652930, 0x24}, {0xc0005ae3c0, 0x34}, {0xc0005ae3f5, 0x9}, {0x276cd40, 0xc0001da000}, 0xc00065b9e8) /home/rclone/go/pkg/mod/github.com/koofr/go-koofrclient@v0.0.0-20221207135200-cbd7fc9ad6a6/client_files.go:285 +0xaad github.com/rclone/rclone/backend/koofr.(*Fs).Put(0xc0006185a0, {0x2791bc0?, 0xc0006c17c0?}, {0x276cd40, 0xc0001da000}, {0x7fc22433d178, 0xc0008e3f20}, {0xc00011e060, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/koofr/koofr.go:424 +0x238 github.com/rclone/rclone/fs/operations.(*copy).updateOrPut(0xc000584240, {0x2791bc0, 0xc0006c17c0}, {0x277f040?, 0xc0007bc000?}, {0xc00011e060, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:217 +0x226 github.com/rclone/rclone/fs/operations.(*copy).manualCopy(0xc000584240, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:270 +0x6d8 github.com/rclone/rclone/fs/operations.(*copy).copy(0xc000584240, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:310 +0x176 github.com/rclone/rclone/fs/operations.Copy({0x2791bc0, 0xc0006c17c0}, {0x27a6600, 0xc0006185a0}, {0x0, 0x0}, {0xc00058a890, 0x9}, {0x27a6830, 0xc0008e3f20}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:412 +0x493 github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc000548a08, {0x2791bc0, 0xc0006c17c0}, 0xc0006c1720, {0x27a6600, 0xc0006185a0}, 0x0, 0xc0006b0228?) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:501 +0x205 created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 75 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:531 +0x6b goroutine 679 [select, 5 minutes]: net/http.(*http2clientStream).writeRequest(0xc0002be780, 0xc0006ae240) /usr/local/go/src/net/http/h2_bundle.go:8491 +0xacc net/http.(*http2clientStream).doRequest(0xc0002be780, 0xc0005c6900?) /usr/local/go/src/net/http/h2_bundle.go:8353 +0x18 created by net/http.(*http2ClientConn).RoundTrip in goroutine 327 /usr/local/go/src/net/http/h2_bundle.go:8259 +0x2ed goroutine 329 [select, 5 minutes]: net/http.(*http2ClientConn).RoundTrip(0xc000716000, 0xc00066a900) /usr/local/go/src/net/http/h2_bundle.go:8323 +0x434 net/http.(*http2Transport).RoundTripOpt(0xc000584fc0, 0xc00066a900, {0xda?}) /usr/local/go/src/net/http/h2_bundle.go:7591 +0x1b1 net/http.(*http2Transport).RoundTrip(...) /usr/local/go/src/net/http/h2_bundle.go:7540 net/http.http2noDialH2RoundTripper.RoundTrip({0xc0002597c0?}, 0xc00066a900?) /usr/local/go/src/net/http/h2_bundle.go:10167 +0x1a net/http.(*Transport).roundTrip(0xc0002597c0, 0xc00066a5a0) /usr/local/go/src/net/http/transport.go:553 +0x39c net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:17 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0005ad650, 0xc00066a5a0) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:352 +0x345 net/http.send(0xc00066a5a0, {0x276dd00, 0xc0005ad650}, {0x1?, 0x8?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e4 net/http.(*Client).send(0xc0006b2900, 0xc00066a5a0, {0x413fdb?, 0x7fc26e188108?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x98 net/http.(*Client).do(0xc0006b2900, 0xc00066a5a0) /usr/local/go/src/net/http/client.go:724 +0x8dc net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:590 github.com/koofr/go-httpclient.(*HTTPClient).Request(0xc000113c70, 0xc00006b6a0) /home/rclone/go/pkg/mod/github.com/koofr/go-httpclient@v0.0.0-20240520111329-e20f8f203988/httpclient.go:346 +0x505 github.com/koofr/go-koofrclient.(*KoofrClient).FilesPutWithOptions(0xc0006b2930, {0xc000652930, 0x24}, {0xc0005dc5f0, 0x3b}, {0xc0005dc62c, 0xa}, {0x276cd40, 0xc000541900}, 0xc00006b9e8) /home/rclone/go/pkg/mod/github.com/koofr/go-koofrclient@v0.0.0-20221207135200-cbd7fc9ad6a6/client_files.go:285 +0xaad github.com/rclone/rclone/backend/koofr.(*Fs).Put(0xc0006185a0, {0x2791bc0?, 0xc0006c17c0?}, {0x276cd40, 0xc000541900}, {0x7fc22433d178, 0xc000788660}, {0xc00050cf90, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/koofr/koofr.go:424 +0x238 github.com/rclone/rclone/fs/operations.(*copy).updateOrPut(0xc000530fc0, {0x2791bc0, 0xc0006c17c0}, {0x277f040?, 0xc0005c4380?}, {0xc00050cf90, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:217 +0x226 github.com/rclone/rclone/fs/operations.(*copy).manualCopy(0xc000530fc0, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:270 +0x6d8 github.com/rclone/rclone/fs/operations.(*copy).copy(0xc000530fc0, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:310 +0x176 github.com/rclone/rclone/fs/operations.Copy({0x2791bc0, 0xc0006c17c0}, {0x27a6600, 0xc0006185a0}, {0x0, 0x0}, {0xc000918120, 0x11}, {0x27a6830, 0xc000788660}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:412 +0x493 github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc000548a08, {0x2791bc0, 0xc0006c17c0}, 0xc0006c1720, {0x27a6600, 0xc0006185a0}, 0x4b, 0x0?) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:501 +0x205 created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 75 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:531 +0x6b goroutine 39 [IO wait, 5 minutes]: internal/poll.runtime_pollWait(0x7fc226700c10, 0x72) /usr/local/go/src/runtime/netpoll.go:345 +0x85 internal/poll.(*pollDesc).wait(0xc000310a00?, 0xc000674000?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc000310a00, {0xc000674000, 0x1300, 0x1300}) /usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a net.(*netFD).Read(0xc000310a00, {0xc000674000?, 0xc0008bf838?, 0x41c385?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 net.(*conn).Read(0xc000089b40, {0xc000674000?, 0x7fc2243897f8?, 0xc0006b0348?}) /usr/local/go/src/net/net.go:179 +0x45 github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc0006fa018, {0xc000674000?, 0x0?, 0x41a6df?}) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x2c crypto/tls.(*atLeastReader).Read(0xc0006b0348, {0xc000674000?, 0x0?, 0xc0006b0348?}) /usr/local/go/src/crypto/tls/conn.go:806 +0x3b bytes.(*Buffer).ReadFrom(0xc0005b02b0, {0x276f100, 0xc0006b0348}) /usr/local/go/src/bytes/buffer.go:211 +0x98 crypto/tls.(*Conn).readFromUntil(0xc0005b0008, {0x7fc2244259d8, 0xc0006fa018}, 0xc0008bf960?) /usr/local/go/src/crypto/tls/conn.go:828 +0xde crypto/tls.(*Conn).readRecordOrCCS(0xc0005b0008, 0x0) /usr/local/go/src/crypto/tls/conn.go:626 +0x3cf crypto/tls.(*Conn).readRecord(...) /usr/local/go/src/crypto/tls/conn.go:588 crypto/tls.(*Conn).Read(0xc0005b0008, {0xc000719000, 0x1000, 0x10?}) /usr/local/go/src/crypto/tls/conn.go:1370 +0x156 bufio.(*Reader).Read(0xc0007100c0, {0xc00071a040, 0x9, 0xc00058ac10?}) /usr/local/go/src/bufio/bufio.go:241 +0x197 io.ReadAtLeast({0x276c640, 0xc0007100c0}, {0xc00071a040, 0x9, 0x9}, 0x9) /usr/local/go/src/io/io.go:335 +0x90 io.ReadFull(...) /usr/local/go/src/io/io.go:354 net/http.http2readFrameHeader({0xc00071a040, 0x9, 0x4857f3?}, {0x276c640?, 0xc0007100c0?}) /usr/local/go/src/net/http/h2_bundle.go:1638 +0x65 net/http.(*http2Framer).ReadFrame(0xc00071a000) /usr/local/go/src/net/http/h2_bundle.go:1902 +0x85 net/http.(*http2clientConnReadLoop).run(0xc0008bffa8) /usr/local/go/src/net/http/h2_bundle.go:9303 +0x12c net/http.(*http2ClientConn).readLoop(0xc000716000) /usr/local/go/src/net/http/h2_bundle.go:9198 +0x65 created by net/http.(*http2Transport).newClientConn in goroutine 38 /usr/local/go/src/net/http/h2_bundle.go:7848 +0xca6 goroutine 328 [select, 5 minutes]: net/http.(*http2ClientConn).RoundTrip(0xc000716000, 0xc0006ae480) /usr/local/go/src/net/http/h2_bundle.go:8323 +0x434 net/http.(*http2Transport).RoundTripOpt(0xc000584fc0, 0xc0006ae480, {0xda?}) /usr/local/go/src/net/http/h2_bundle.go:7591 +0x1b1 net/http.(*http2Transport).RoundTrip(...) /usr/local/go/src/net/http/h2_bundle.go:7540 net/http.http2noDialH2RoundTripper.RoundTrip({0xc0002597c0?}, 0xc0006ae480?) /usr/local/go/src/net/http/h2_bundle.go:10167 +0x1a net/http.(*Transport).roundTrip(0xc0002597c0, 0xc0006ae360) /usr/local/go/src/net/http/transport.go:553 +0x39c net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:17 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0005ad650, 0xc0006ae360) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:352 +0x345 net/http.send(0xc0006ae360, {0x276dd00, 0xc0005ad650}, {0x1?, 0x8?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e4 net/http.(*Client).send(0xc0006b2900, 0xc0006ae360, {0x413fdb?, 0x160?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x98 net/http.(*Client).do(0xc0006b2900, 0xc0006ae360) /usr/local/go/src/net/http/client.go:724 +0x8dc net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:590 github.com/koofr/go-httpclient.(*HTTPClient).Request(0xc000113c70, 0xc0007a96a0) /home/rclone/go/pkg/mod/github.com/koofr/go-httpclient@v0.0.0-20240520111329-e20f8f203988/httpclient.go:346 +0x505 github.com/koofr/go-koofrclient.(*KoofrClient).FilesPutWithOptions(0xc0006b2930, {0xc000652930, 0x24}, {0xc0005dc1e0, 0x34}, {0xc0005dc215, 0xf}, {0x276cd40, 0xc000541600}, 0xc0007a99e8) /home/rclone/go/pkg/mod/github.com/koofr/go-koofrclient@v0.0.0-20221207135200-cbd7fc9ad6a6/client_files.go:285 +0xaad github.com/rclone/rclone/backend/koofr.(*Fs).Put(0xc0006185a0, {0x2791bc0?, 0xc0006c17c0?}, {0x276cd40, 0xc000541600}, {0x7fc22433d178, 0xc00010e4e0}, {0xc00050c250, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/koofr/koofr.go:424 +0x238 github.com/rclone/rclone/fs/operations.(*copy).updateOrPut(0xc000584090, {0x2791bc0, 0xc0006c17c0}, {0x277f040?, 0xc0005c40e0?}, {0xc00050c250, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:217 +0x226 github.com/rclone/rclone/fs/operations.(*copy).manualCopy(0xc000584090, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:270 +0x6d8 github.com/rclone/rclone/fs/operations.(*copy).copy(0xc000584090, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:310 +0x176 github.com/rclone/rclone/fs/operations.Copy({0x2791bc0, 0xc0006c17c0}, {0x27a6600, 0xc0006185a0}, {0x0, 0x0}, {0xc00058a8d0, 0xf}, {0x27a6830, 0xc00010e4e0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:412 +0x493 github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc000548a08, {0x2791bc0, 0xc0006c17c0}, 0xc0006c1720, {0x27a6600, 0xc0006185a0}, 0x32, 0x0?) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:501 +0x205 created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 75 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:531 +0x6b goroutine 327 [select, 5 minutes]: net/http.(*http2ClientConn).RoundTrip(0xc000716000, 0xc0006ae240) /usr/local/go/src/net/http/h2_bundle.go:8323 +0x434 net/http.(*http2Transport).RoundTripOpt(0xc000584fc0, 0xc0006ae240, {0xda?}) /usr/local/go/src/net/http/h2_bundle.go:7591 +0x1b1 net/http.(*http2Transport).RoundTrip(...) /usr/local/go/src/net/http/h2_bundle.go:7540 net/http.http2noDialH2RoundTripper.RoundTrip({0xc0002597c0?}, 0xc0006ae240?) /usr/local/go/src/net/http/h2_bundle.go:10167 +0x1a net/http.(*Transport).roundTrip(0xc0002597c0, 0xc0006ae120) /usr/local/go/src/net/http/transport.go:553 +0x39c net/http.(*Transport).RoundTrip(...) /usr/local/go/src/net/http/roundtrip.go:17 github.com/rclone/rclone/fs/fshttp.(*Transport).RoundTrip(0xc0005ad650, 0xc0006ae120) /home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/http.go:352 +0x345 net/http.send(0xc0006ae120, {0x276dd00, 0xc0005ad650}, {0x1?, 0x8?, 0x0?}) /usr/local/go/src/net/http/client.go:259 +0x5e4 net/http.(*Client).send(0xc0006b2900, 0xc0006ae120, {0x413fdb?, 0x7fc26e188a68?, 0x0?}) /usr/local/go/src/net/http/client.go:180 +0x98 net/http.(*Client).do(0xc0006b2900, 0xc0006ae120) /usr/local/go/src/net/http/client.go:724 +0x8dc net/http.(*Client).Do(...) /usr/local/go/src/net/http/client.go:590 github.com/koofr/go-httpclient.(*HTTPClient).Request(0xc000113c70, 0xc0007ad6a0) /home/rclone/go/pkg/mod/github.com/koofr/go-httpclient@v0.0.0-20240520111329-e20f8f203988/httpclient.go:346 +0x505 github.com/koofr/go-koofrclient.(*KoofrClient).FilesPutWithOptions(0xc0006b2930, {0xc000652930, 0x24}, {0xc00077a1c0, 0x34}, {0xc00077a1f5, 0xb}, {0x276cd40, 0xc000541800}, 0xc0007ad9e8) /home/rclone/go/pkg/mod/github.com/koofr/go-koofrclient@v0.0.0-20221207135200-cbd7fc9ad6a6/client_files.go:285 +0xaad github.com/rclone/rclone/backend/koofr.(*Fs).Put(0xc0006185a0, {0x2791bc0?, 0xc0006c17c0?}, {0x276cd40, 0xc000541800}, {0x7fc22433d178, 0xc00010e5a0}, {0xc00050c770, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/backend/koofr/koofr.go:424 +0x238 github.com/rclone/rclone/fs/operations.(*copy).updateOrPut(0xc000530e10, {0x2791bc0, 0xc0006c17c0}, {0x277f040?, 0xc0005c42a0?}, {0xc00050c770, 0x1, 0x1}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:217 +0x226 github.com/rclone/rclone/fs/operations.(*copy).manualCopy(0xc000530e10, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:270 +0x6d8 github.com/rclone/rclone/fs/operations.(*copy).copy(0xc000530e10, {0x2791bc0, 0xc0006c17c0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:310 +0x176 github.com/rclone/rclone/fs/operations.Copy({0x2791bc0, 0xc0006c17c0}, {0x27a6600, 0xc0006185a0}, {0x0, 0x0}, {0xc00058a940, 0xb}, {0x27a6830, 0xc00010e5a0}) /home/rclone/go/src/github.com/rclone/rclone/fs/operations/copy.go:412 +0x493 github.com/rclone/rclone/fs/sync.(*syncCopyMove).pairCopyOrMove(0xc000548a08, {0x2791bc0, 0xc0006c17c0}, 0xc0006c1720, {0x27a6600, 0xc0006185a0}, 0x19, 0x5553796632555366?) /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:501 +0x205 created by github.com/rclone/rclone/fs/sync.(*syncCopyMove).startTransfers in goroutine 75 /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync.go:531 +0x6b goroutine 669 [select]: github.com/rclone/rclone/fs/accounting.(*Account).averageLoop(0xc000541800) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:221 +0xf6 created by github.com/rclone/rclone/fs/accounting.newAccountSizeName in goroutine 327 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:119 +0x438 goroutine 681 [select, 5 minutes]: net/http.(*http2clientStream).writeRequest(0xc0002bf980, 0xc0006ae480) /usr/local/go/src/net/http/h2_bundle.go:8491 +0xacc net/http.(*http2clientStream).doRequest(0xc0002bf980, 0xc0005c1f38?) /usr/local/go/src/net/http/h2_bundle.go:8353 +0x18 created by net/http.(*http2ClientConn).RoundTrip in goroutine 328 /usr/local/go/src/net/http/h2_bundle.go:8259 +0x2ed goroutine 665 [chan receive, 5 minutes]: github.com/rclone/rclone/backend/local.(*fadvise).worker(0xc0004c8080) /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:114 +0x3f created by github.com/rclone/rclone/backend/local.newFadvise in goroutine 328 /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:74 +0x11f goroutine 338 [chan receive, 59 minutes]: github.com/rclone/rclone/fs/march.(*March).Run.func2() /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:211 +0x3c created by github.com/rclone/rclone/fs/march.(*March).Run in goroutine 75 /home/rclone/go/src/github.com/rclone/rclone/fs/march/march.go:209 +0x378 goroutine 668 [chan receive, 5 minutes]: github.com/rclone/rclone/backend/local.(*fadvise).worker(0xc0004c80c0) /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:114 +0x3f created by github.com/rclone/rclone/backend/local.newFadvise in goroutine 327 /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:74 +0x11f goroutine 683 [select, 5 minutes]: net/http.(*http2clientStream).writeRequest(0xc0006d6000, 0xc0006ae6c0) /usr/local/go/src/net/http/h2_bundle.go:8491 +0xacc net/http.(*http2clientStream).doRequest(0xc0006d6000, 0xc0005c6900?) /usr/local/go/src/net/http/h2_bundle.go:8353 +0x18 created by net/http.(*http2ClientConn).RoundTrip in goroutine 326 /usr/local/go/src/net/http/h2_bundle.go:8259 +0x2ed goroutine 672 [select]: github.com/rclone/rclone/fs/accounting.(*Account).averageLoop(0xc000541900) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:221 +0xf6 created by github.com/rclone/rclone/fs/accounting.newAccountSizeName in goroutine 329 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:119 +0x438 goroutine 691 [select]: github.com/rclone/rclone/fs/accounting.(*Account).averageLoop(0xc0001da000) /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:221 +0xf6 created by github.com/rclone/rclone/fs/accounting.newAccountSizeName in goroutine 326 /home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting.go:119 +0x438 goroutine 690 [chan receive, 5 minutes]: github.com/rclone/rclone/backend/local.(*fadvise).worker(0xc00062c140) /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:114 +0x3f created by github.com/rclone/rclone/backend/local.newFadvise in goroutine 326 /home/rclone/go/src/github.com/rclone/rclone/backend/local/fadvise_unix.go:74 +0x11f goroutine 707 [select, 5 minutes]: net/http.(*http2clientStream).writeRequest(0xc000003b00, 0xc00066a900) /usr/local/go/src/net/http/h2_bundle.go:8491 +0xacc net/http.(*http2clientStream).doRequest(0xc000003b00, 0xc00060cf58?) /usr/local/go/src/net/http/h2_bundle.go:8353 +0x18 created by net/http.(*http2ClientConn).RoundTrip in goroutine 329 /usr/local/go/src/net/http/h2_bundle.go:8259 +0x2ed "./bisync.test -test.v -test.timeout 1h0m0s -remote TestKoofr: -verbose" - Finished ERROR in 1h0m0.61758577s (try 5/5): exit status 2: Failed [TestBisyncRemoteLocal/changes TestBisyncRemoteLocal/check_sync TestBisyncRemoteLocal/compare_all TestBisyncRemoteLocal/createemptysrcdirs TestBisyncRemoteLocal/dry_run TestBisyncRemoteLocal/equal TestBisyncRemoteLocal/ext_paths TestBisyncRemoteLocal/extended_filenames TestBisyncRemoteLocal/filters TestBisyncRemoteLocal/filtersfile_checks TestBisyncRemoteLocal/ignorelistingchecksum TestBisyncRemoteLocal/max_delete_path1 TestBisyncRemoteLocal/max_delete_path2_force TestBisyncRemoteLocal/nomodtime TestBisyncRemoteLocal/normalization TestBisyncRemoteLocal/rclone_args TestBisyncRemoteLocal/resolve TestBisyncRemoteLocal/resync TestBisyncRemoteLocal/resync_modes TestBisyncRemoteLocal/rmdirs TestBisyncRemoteLocal/volatile TestBisyncLocalRemote/all_changed TestBisyncLocalRemote/backupdir TestBisyncLocalRemote/basic TestBisyncLocalRemote/changes TestBisyncLocalRemote/check_access TestBisyncLocalRemote/check_access_filters TestBisyncLocalRemote/check_filename TestBisyncLocalRemote/check_sync TestBisyncLocalRemote/compare_all TestBisyncLocalRemote/createemptysrcdirs TestBisyncLocalRemote/dry_run TestBisyncLocalRemote/equal TestBisyncLocalRemote/ext_paths TestBisyncLocalRemote/extended_filenames TestBisyncLocalRemote/filters TestBisyncLocalRemote/filtersfile_checks TestBisyncLocalRemote/ignorelistingchecksum TestBisyncLocalRemote/max_delete_path1 TestBisyncLocalRemote/max_delete_path2_force TestBisyncLocalRemote/nomodtime TestBisyncLocalRemote/normalization TestBisyncLocalRemote/rclone_args TestBisyncLocalRemote/resolve TestBisyncLocalRemote/resync TestBisyncLocalRemote/resync_modes TestBisyncLocalRemote/rmdirs TestBisyncLocalRemote/volatile TestBisyncRemoteRemote/all_changed TestBisyncRemoteRemote/backupdir TestBisyncRemoteRemote/basic TestBisyncRemoteRemote/changes TestBisyncRemoteRemote/check_access TestBisyncRemoteRemote/check_access_filters TestBisyncRemoteRemote/check_filename TestBisyncRemoteRemote/check_sync TestBisyncRemoteRemote/compare_all TestBisyncRemoteRemote/createemptysrcdirs TestBisyncRemoteRemote/dry_run TestBisyncRemoteRemote/equal TestBisyncRemoteRemote/ext_paths TestBisyncRemoteRemote/extended_filenames TestBisyncRemoteRemote/filters TestBisyncRemoteRemote/filtersfile_checks TestBisyncRemoteRemote/ignorelistingchecksum TestBisyncRemoteRemote/max_delete_path1 TestBisyncRemoteRemote/max_delete_path2_force TestBisyncRemoteRemote/nomodtime TestBisyncRemoteRemote/normalization TestBisyncRemoteRemote/rclone_args TestBisyncRemoteRemote/resolve TestBisyncRemoteRemote/resync TestBisyncRemoteRemote/resync_modes TestBisyncRemoteRemote/rmdirs TestBisyncRemoteRemote/volatile]