"go test -v -timeout 1h0m0s -remote TestZoho: -verbose" - Starting (try 1/5)
=== RUN TestIntegration
fstests.go:438: Using remote "TestZoho:"
2025/03/05 01:08:12 DEBUG : Creating backend with remote "TestZoho:rclone-test-qokowik7wibo"
2025/03/05 01:08:12 DEBUG : Using config file from "/home/rclone/.rclone.conf"
=== RUN TestIntegration/FsCheckWrap
fstests.go:479: Not a wrapping Fs
=== RUN TestIntegration/FsCommand
fstests.go:507: No commands in this remote
=== RUN TestIntegration/FsRmdirNotFound
=== RUN TestIntegration/FsString
=== RUN TestIntegration/FsName
=== RUN TestIntegration/FsRoot
=== RUN TestIntegration/FsRmdirEmpty
=== RUN TestIntegration/FsMkdir
=== RUN TestIntegration/FsMkdir/FsMkdirRmdirSubdir
2025/03/05 01:08:14 INFO : dir/subdir: Making directory
2025/03/05 01:08:14 INFO : dir/subdir: Removing directory
2025/03/05 01:08:14 INFO : dir: Removing directory
=== RUN TestIntegration/FsMkdir/FsListEmpty
=== RUN TestIntegration/FsMkdir/FsListDirEmpty
=== RUN TestIntegration/FsMkdir/FsListRDirEmpty
fstests.go:399: FS has no ListR interface
=== RUN TestIntegration/FsMkdir/FsListDirNotFound
2025/03/05 01:08:15 ERROR : does not exist: error listing: directory not found
=== RUN TestIntegration/FsMkdir/FsListRDirNotFound
fstests.go:399: FS has no ListR interface
=== RUN TestIntegration/FsMkdir/FsEncoding
=== RUN TestIntegration/FsMkdir/FsEncoding/control_chars
fstests.go:707: testing "␀␁␂␃␄␅␆␇␈␉␊␋␌␍␎␏␐␑␒␓␔␕␖␗␘␙␚␛␜␝␞␟␡"
=== RUN TestIntegration/FsMkdir/FsEncoding/dot
fstests.go:707: testing "．"
=== RUN TestIntegration/FsMkdir/FsEncoding/dot_dot
fstests.go:707: testing "．．"
=== RUN TestIntegration/FsMkdir/FsEncoding/punctuation
fstests.go:707: testing "!\"#$%&'()*+,-.／:;<=>?@[\\]^_`{|}~"
2025/03/05 01:08:18 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:08:18 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:08:18 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 01:08:18 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:08:18 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:09:18 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:09:18 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:10:18 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:10:18 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:11:18 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:11:18 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:12:18 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:12:18 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:13:18 DEBUG : pacer: Reducing sleep to 45s
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_space
fstests.go:707: testing " leading space"
2025/03/05 01:14:18 DEBUG : pacer: Reducing sleep to 33.75s
2025/03/05 01:15:03 DEBUG : pacer: Reducing sleep to 25.3125s
2025/03/05 01:15:37 DEBUG : pacer: Reducing sleep to 18.984375s
2025/03/05 01:16:02 DEBUG : pacer: Reducing sleep to 14.23828125s
2025/03/05 01:16:21 DEBUG : pacer: Reducing sleep to 10.678710937s
2025/03/05 01:16:35 DEBUG : pacer: Reducing sleep to 8.009033202s
2025/03/05 01:16:46 DEBUG : pacer: Reducing sleep to 6.006774901s
2025/03/05 01:16:54 DEBUG : pacer: Reducing sleep to 4.505081175s
2025/03/05 01:17:00 DEBUG : pacer: Reducing sleep to 3.378810881s
2025/03/05 01:17:05 DEBUG : pacer: Reducing sleep to 2.53410816s
2025/03/05 01:17:08 DEBUG : pacer: Reducing sleep to 1.90058112s
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_tilde
fstests.go:707: testing "~leading tilde"
2025/03/05 01:17:11 DEBUG : pacer: Reducing sleep to 1.42543584s
2025/03/05 01:17:12 DEBUG : pacer: Reducing sleep to 1.06907688s
2025/03/05 01:17:14 DEBUG : pacer: Reducing sleep to 801.80766ms
2025/03/05 01:17:15 DEBUG : pacer: Reducing sleep to 601.355745ms
2025/03/05 01:17:16 DEBUG : pacer: Reducing sleep to 451.016808ms
2025/03/05 01:17:16 DEBUG : pacer: Reducing sleep to 338.262606ms
2025/03/05 01:17:17 DEBUG : pacer: Reducing sleep to 253.696954ms
2025/03/05 01:17:17 DEBUG : pacer: Reducing sleep to 190.272715ms
2025/03/05 01:17:17 DEBUG : pacer: Reducing sleep to 142.704536ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 107.028402ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 80.271301ms
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_CR
fstests.go:707: testing "␍leading CR"
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 60.203475ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 45.152606ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 33.864454ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 25.39834ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 19.048755ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 14.286566ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 10.714924ms
2025/03/05 01:17:18 DEBUG : pacer: Reducing sleep to 10ms
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_LF
fstests.go:707: testing "␊leading LF"
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_HT
fstests.go:707: testing "␉leading HT"
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_VT
fstests.go:707: testing "␋leading VT"
=== RUN TestIntegration/FsMkdir/FsEncoding/leading_dot
fstests.go:707: testing ".leading dot"
=== RUN TestIntegration/FsMkdir/FsEncoding/trailing_space
fstests.go:707: testing "trailing space "
2025/03/05 01:17:22 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:17:22 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:17:22 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 01:17:22 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:17:22 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:18:22 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:18:22 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:19:22 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:19:22 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:20:22 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:20:22 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:21:22 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:21:22 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:22:22 DEBUG : pacer: Reducing sleep to 45s
2025/03/05 01:23:22 DEBUG : pacer: Reducing sleep to 33.75s
2025/03/05 01:24:07 DEBUG : pacer: Reducing sleep to 25.3125s
2025/03/05 01:24:41 DEBUG : pacer: Reducing sleep to 18.984375s
2025/03/05 01:25:06 DEBUG : pacer: Reducing sleep to 14.23828125s
2025/03/05 01:25:25 DEBUG : pacer: Reducing sleep to 10.678710937s
2025/03/05 01:25:39 DEBUG : pacer: Reducing sleep to 8.009033202s
2025/03/05 01:25:50 DEBUG : pacer: Reducing sleep to 6.006774901s
2025/03/05 01:25:58 DEBUG : pacer: Reducing sleep to 4.505081175s
2025/03/05 01:26:04 DEBUG : pacer: Reducing sleep to 3.378810881s
2025/03/05 01:26:08 DEBUG : pacer: Reducing sleep to 2.53410816s
=== RUN TestIntegration/FsMkdir/FsEncoding/trailing_CR
fstests.go:707: testing "trailing CR␍"
2025/03/05 01:26:12 DEBUG : pacer: Reducing sleep to 1.90058112s
2025/03/05 01:26:14 DEBUG : pacer: Reducing sleep to 1.42543584s
2025/03/05 01:26:16 DEBUG : pacer: Reducing sleep to 1.06907688s
2025/03/05 01:26:18 DEBUG : pacer: Reducing sleep to 801.80766ms
2025/03/05 01:26:19 DEBUG : pacer: Reducing sleep to 601.355745ms
2025/03/05 01:26:20 DEBUG : pacer: Reducing sleep to 451.016808ms
2025/03/05 01:26:20 DEBUG : pacer: Reducing sleep to 338.262606ms
2025/03/05 01:26:21 DEBUG : pacer: Reducing sleep to 253.696954ms
2025/03/05 01:26:21 DEBUG : pacer: Reducing sleep to 190.272715ms
2025/03/05 01:26:21 DEBUG : pacer: Reducing sleep to 142.704536ms
2025/03/05 01:26:21 DEBUG : pacer: Reducing sleep to 107.028402ms
=== RUN TestIntegration/FsMkdir/FsEncoding/trailing_LF
fstests.go:707: testing "trailing LF␊"
2025/03/05 01:26:21 DEBUG : pacer: Reducing sleep to 80.271301ms
2025/03/05 01:26:22 DEBUG : pacer: Reducing sleep to 60.203475ms
2025/03/05 01:26:22 DEBUG : pacer: Reducing sleep to 45.152606ms
2025/03/05 01:26:22 DEBUG : pacer: Reducing sleep to 33.864454ms
2025/03/05 01:26:22 DEBUG : pacer: Reducing sleep to 25.39834ms
2025/03/05 01:26:22 DEBUG : pacer: Reducing sleep to 19.048755ms
2025/03/05 01:26:23 DEBUG : pacer: Reducing sleep to 14.286566ms
2025/03/05 01:26:23 DEBUG : pacer: Reducing sleep to 10.714924ms
2025/03/05 01:26:23 DEBUG : pacer: Reducing sleep to 10ms
=== RUN TestIntegration/FsMkdir/FsEncoding/trailing_HT
fstests.go:707: testing "trailing HT␉"
=== RUN TestIntegration/FsMkdir/FsEncoding/trailing_VT
fstests.go:707: testing "trailing VT␋"
=== RUN TestIntegration/FsMkdir/FsEncoding/trailing_dot
fstests.go:707: testing "trailing dot."
=== RUN TestIntegration/FsMkdir/FsEncoding/invalid_UTF-8
fstests.go:699: Skipping invalid UTF-8
=== RUN TestIntegration/FsMkdir/FsEncoding/URL_encoding
fstests.go:707: testing "test%46.txt"
=== RUN TestIntegration/FsMkdir/FsNewObjectNotFound
2025/03/05 01:26:26 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:26:26 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:26:26 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 01:26:26 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:26:26 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:27:26 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:27:26 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:28:26 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:28:26 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:29:26 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:29:26 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:30:26 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:30:26 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:31:26 DEBUG : pacer: Reducing sleep to 45s
=== RUN TestIntegration/FsMkdir/FsPutError
2025/03/05 01:32:26 DEBUG : pacer: Reducing sleep to 33.75s
2025/03/05 01:33:11 DEBUG : pacer: Reducing sleep to 25.3125s
2025/03/05 01:33:45 DEBUG : pacer: Reducing sleep to 18.984375s
2025/03/05 01:34:10 DEBUG : pacer: Reducing sleep to 14.23828125s
2025/03/05 01:34:29 DEBUG : pacer: Reducing sleep to 10.678710937s
2025/03/05 01:34:43 DEBUG : pacer: Reducing sleep to 8.009033202s
2025/03/05 01:34:54 DEBUG : pacer: Reducing sleep to 6.006774901s
2025/03/05 01:35:02 DEBUG : pacer: Reducing sleep to 4.505081175s
2025/03/05 01:35:08 DEBUG : pacer: Reducing sleep to 3.378810881s
2025/03/05 01:35:13 DEBUG : pacer: Reducing sleep to 2.53410816s
2025/03/05 01:35:16 DEBUG : pacer: Reducing sleep to 1.90058112s
=== RUN TestIntegration/FsMkdir/FsPutZeroLength
2025/03/05 01:35:19 DEBUG : pacer: Reducing sleep to 1.42543584s
2025/03/05 01:35:21 DEBUG : pacer: Reducing sleep to 1.06907688s
2025/03/05 01:35:22 DEBUG : pacer: Reducing sleep to 801.80766ms
2025/03/05 01:35:23 DEBUG : Couldn't parse Date: from server download.zoho.eu: "Wed, 05 Mar 2025 01:35:23 UTC": parsing time "Wed, 05 Mar 2025 01:35:23 UTC" as "Mon Jan _2 15:04:05 2006": cannot parse ", 05 Mar 2025 01:35:23 UTC" as " "
2025/03/05 01:35:23 ERROR : zoho: missing OAuth Scope. Run rclone config reconnect to fix this issue.
2025/03/05 01:35:23 DEBUG : pacer: Reducing sleep to 601.355745ms
fstests.go:262:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:262
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:275
Error: Received unexpected error:
HTTP error 401 (401 INVALID_OAUTHSCOPE) returned body: "{\"ERROR_MESSAGE\":\"INVALID_OAUTHSCOPE\",\"ERROR_CODE\":401}"
Test: TestIntegration/FsMkdir/FsPutZeroLength
=== RUN TestIntegration/FsMkdir/FsOpenWriterAt
fstests.go:786: FS has no OpenWriterAt interface
=== RUN TestIntegration/FsMkdir/FsOpenChunkWriter
fstests.go:819: FS has no OpenChunkWriter interface
=== RUN TestIntegration/FsMkdir/FsChangeNotify
fstests.go:868: FS has no ChangeNotify interface
=== RUN TestIntegration/FsMkdir/FsPutFiles
2025/03/05 01:35:24 DEBUG : pacer: Reducing sleep to 451.016808ms
2025/03/05 01:35:24 DEBUG : pacer: Reducing sleep to 338.262606ms
2025/03/05 01:35:25 DEBUG : pacer: Reducing sleep to 253.696954ms
2025/03/05 01:35:25 DEBUG : pacer: Reducing sleep to 190.272715ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 142.704536ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 107.028402ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 80.271301ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 60.203475ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 45.152606ms
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListDirFile2
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 33.864454ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 25.39834ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 19.048755ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 14.286566ms
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 10.714924ms
fstests.go:979:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:979
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:998
Error: Not equal:
expected: []string{"file name.txt"}
actual : []string{"file name.txt", "zero-length-file"}
Diff:
--- Expected
+++ Actual
@@ -1,3 +1,4 @@
-([]string) (len=1) {
- (string) (len=13) "file name.txt"
+([]string) (len=2) {
+ (string) (len=13) "file name.txt",
+ (string) (len=16) "zero-length-file"
}
Test: TestIntegration/FsMkdir/FsPutFiles/FsListDirFile2
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListRDirFile2
fstests.go:399: FS has no ListR interface
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListR
2025/03/05 01:35:26 DEBUG : pacer: Reducing sleep to 10ms
fstests.go:1021:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1021
Error: Not equal:
expected: []string{"file name.txt", "hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt"}
actual : []string{"file name.txt", "hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt", "zero-length-file"}
Diff:
--- Expected
+++ Actual
@@ -1,4 +1,5 @@
-([]string) (len=2) {
+([]string) (len=3) {
(string) (len=13) "file name.txt",
- (string) (len=60) "hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt"
+ (string) (len=60) "hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt",
+ (string) (len=16) "zero-length-file"
}
Test: TestIntegration/FsMkdir/FsPutFiles/FsListR
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListDirRoot
2025/03/05 01:35:27 DEBUG : Creating backend with remote "TestZoho:"
2025/03/05 01:35:27 DEBUG : Config file has changed externally - reloading
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListRDirRoot
fstests.go:399: FS has no ListR interface
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListSubdir
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListRSubdir#01
fstests.go:399: FS has no ListR interface
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListLevel2
fstests.go:1093:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1093
Error: Not equal:
expected: []string{"file name.txt"}
actual : []string{"file name.txt", "zero-length-file"}
Diff:
--- Expected
+++ Actual
@@ -1,3 +1,4 @@
-([]string) (len=1) {
- (string) (len=13) "file name.txt"
+([]string) (len=2) {
+ (string) (len=13) "file name.txt",
+ (string) (len=16) "zero-length-file"
}
Test: TestIntegration/FsMkdir/FsPutFiles/FsListLevel2
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListRLevel2
fstests.go:399: FS has no ListR interface
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListFile1
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1107
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsListFile1
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1107
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsListFile1
Messages: Unexpected file "zero-length-file"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObject
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObjectCaseInsensitive
fstests.go:1121: Not Case Insensitive
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListFile1and2
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1134
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsListFile1and2
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1134
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsListFile1and2
Messages: Unexpected file "zero-length-file"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsNewObjectDir
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsPurge
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:35:46 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:35:46 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:35:46 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 01:35:46 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:35:46 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:36:47 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:36:47 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:37:46 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:37:46 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:38:46 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:38:46 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:39:46 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:39:46 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:40:46 DEBUG : pacer: Reducing sleep to 45s
2025/03/05 01:41:46 DEBUG : pacer: Reducing sleep to 33.75s
2025/03/05 01:42:31 DEBUG : pacer: Reducing sleep to 25.3125s
2025/03/05 01:43:05 DEBUG : pacer: Reducing sleep to 18.984375s
2025/03/05 01:43:30 DEBUG : pacer: Reducing sleep to 14.23828125s
2025/03/05 01:43:49 DEBUG : pacer: Reducing sleep to 10.678710937s
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:44:04 DEBUG : pacer: Reducing sleep to 8.009033202s
2025/03/05 01:44:14 DEBUG : pacer: Reducing sleep to 6.006774901s
2025/03/05 01:44:22 DEBUG : pacer: Reducing sleep to 4.505081175s
2025/03/05 01:44:28 DEBUG : pacer: Reducing sleep to 3.378810881s
2025/03/05 01:44:33 DEBUG : pacer: Reducing sleep to 2.53410816s
2025/03/05 01:44:36 DEBUG : pacer: Reducing sleep to 1.90058112s
2025/03/05 01:44:39 DEBUG : pacer: Reducing sleep to 1.42543584s
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1163
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurge
Messages: listing wrong, want
dirToPurge/fileToPurge.txt (100), file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
dirToPurge/fileToPurge.txt (100), file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1163
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurge
Messages: Unexpected file "zero-length-file"
2025/03/05 01:44:43 DEBUG : pacer: Reducing sleep to 1.06907688s
2025/03/05 01:44:44 DEBUG : pacer: Reducing sleep to 801.80766ms
2025/03/05 01:44:45 DEBUG : pacer: Reducing sleep to 601.355745ms
2025/03/05 01:44:46 DEBUG : pacer: Reducing sleep to 451.016808ms
2025/03/05 01:44:47 DEBUG : pacer: Reducing sleep to 338.262606ms
2025/03/05 01:44:47 DEBUG : pacer: Reducing sleep to 253.696954ms
2025/03/05 01:44:47 DEBUG : pacer: Reducing sleep to 190.272715ms
2025/03/05 01:44:48 DEBUG : pacer: Reducing sleep to 142.704536ms
2025/03/05 01:44:48 DEBUG : pacer: Reducing sleep to 107.028402ms
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:44:49 DEBUG : pacer: Reducing sleep to 80.271301ms
2025/03/05 01:44:49 DEBUG : pacer: Reducing sleep to 60.203475ms
2025/03/05 01:44:49 DEBUG : pacer: Reducing sleep to 45.152606ms
2025/03/05 01:44:49 DEBUG : pacer: Reducing sleep to 33.864454ms
2025/03/05 01:44:49 DEBUG : pacer: Reducing sleep to 25.39834ms
2025/03/05 01:44:49 DEBUG : pacer: Reducing sleep to 19.048755ms
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:44:51 DEBUG : pacer: Reducing sleep to 14.286566ms
2025/03/05 01:44:52 DEBUG : pacer: Reducing sleep to 10.714924ms
2025/03/05 01:44:52 DEBUG : pacer: Reducing sleep to 10ms
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1175
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurge
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1175
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurge
Messages: Unexpected file "zero-length-file"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1200
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot
Messages: listing wrong, want
dirToPurgeFromRoot/fileToPurgeFromRoot.txt (100), file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
dirToPurgeFromRoot/fileToPurgeFromRoot.txt (100), file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1200
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot
Messages: Unexpected file "zero-length-file"
2025/03/05 01:45:05 DEBUG : Creating backend with remote "TestZoho:rclone-test-qokowik7wibo/dirToPurgeFromRoot"
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1217
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1217
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsPurgeRoot
Messages: Unexpected file "zero-length-file"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsListRootedSubdir
2025/03/05 01:45:13 DEBUG : Creating backend with remote "TestZoho:rclone-test-qokowik7wibo/hello? sausage/êé"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsCopy
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1270
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsCopy
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt-copy (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt-copy (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1270
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsCopy
Messages: Unexpected file "zero-length-file"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsCopy/Metadata
fstests.go:1289: Skipping test as can't write metadata
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsMove
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:45:27 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:45:27 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:45:27 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 01:45:27 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:45:27 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:46:27 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:46:27 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:47:27 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:47:27 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:48:27 DEBUG : TestZoho: Loaded invalid token from config file - ignoring
2025/03/05 01:48:27 DEBUG : Saving config "token" in section "TestZoho" of the config file
2025/03/05 01:48:27 DEBUG : TestZoho: Saved new token in config file
2025/03/05 01:48:27 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:48:27 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:49:27 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:49:27 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:50:27 DEBUG : pacer: Reducing sleep to 45s
2025/03/05 01:51:27 DEBUG : pacer: Reducing sleep to 33.75s
2025/03/05 01:52:12 DEBUG : pacer: Reducing sleep to 25.3125s
2025/03/05 01:52:46 DEBUG : pacer: Reducing sleep to 18.984375s
2025/03/05 01:53:11 DEBUG : pacer: Reducing sleep to 14.23828125s
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:53:30 DEBUG : pacer: Reducing sleep to 10.678710937s
2025/03/05 01:53:44 DEBUG : pacer: Reducing sleep to 8.009033202s
2025/03/05 01:53:55 DEBUG : pacer: Reducing sleep to 6.006774901s
2025/03/05 01:54:03 DEBUG : pacer: Reducing sleep to 4.505081175s
2025/03/05 01:54:09 DEBUG : pacer: Reducing sleep to 3.378810881s
2025/03/05 01:54:13 DEBUG : pacer: Reducing sleep to 2.53410816s
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1362
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: listing wrong, want
file name.txt (100), other.txt (100) got
file name.txt (100), other.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1362
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: Unexpected file "zero-length-file"
2025/03/05 01:54:17 DEBUG : pacer: Reducing sleep to 1.90058112s
2025/03/05 01:54:20 DEBUG : pacer: Reducing sleep to 1.42543584s
2025/03/05 01:54:22 DEBUG : pacer: Reducing sleep to 1.06907688s
2025/03/05 01:54:23 DEBUG : pacer: Reducing sleep to 801.80766ms
2025/03/05 01:54:24 DEBUG : pacer: Reducing sleep to 601.355745ms
2025/03/05 01:54:25 DEBUG : pacer: Reducing sleep to 451.016808ms
2025/03/05 01:54:26 DEBUG : pacer: Reducing sleep to 338.262606ms
2025/03/05 01:54:26 DEBUG : pacer: Reducing sleep to 253.696954ms
2025/03/05 01:54:27 DEBUG : pacer: Reducing sleep to 190.272715ms
2025/03/05 01:54:27 DEBUG : pacer: Reducing sleep to 142.704536ms
2025/03/05 01:54:27 DEBUG : pacer: Reducing sleep to 107.028402ms
2025/03/05 01:54:27 DEBUG : pacer: Reducing sleep to 80.271301ms
2025/03/05 01:54:27 DEBUG : pacer: Reducing sleep to 60.203475ms
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:54:28 DEBUG : pacer: Reducing sleep to 45.152606ms
2025/03/05 01:54:28 DEBUG : pacer: Reducing sleep to 33.864454ms
2025/03/05 01:54:28 DEBUG : pacer: Reducing sleep to 25.39834ms
2025/03/05 01:54:28 DEBUG : pacer: Reducing sleep to 19.048755ms
2025/03/05 01:54:29 DEBUG : pacer: Reducing sleep to 14.286566ms
2025/03/05 01:54:29 DEBUG : pacer: Reducing sleep to 10.714924ms
2025/03/05 01:54:29 DEBUG : pacer: Reducing sleep to 10ms
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1373
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: listing wrong, want
moveTest/other.txt (100), other.txt (100) got
moveTest/other.txt (100), other.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1373
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: Unexpected file "zero-length-file"
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1381
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: listing wrong, want
file name.txt (100), other.txt (100) got
file name.txt (100), other.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1381
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: Unexpected file "zero-length-file"
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1388
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1388
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsMove
Messages: Unexpected file "zero-length-file"
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsMove/Metadata
fstests.go:1398: Skipping test as can't write metadata
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsDirMove
2025/03/05 01:54:53 DEBUG : Creating backend with remote "TestZoho:rclone-test-vavocad4niko"
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1485
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsDirMove
Messages: listing wrong, want
new_name/sub_new_name/file name.txt (100), new_name/sub_new_name/hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
new_name/sub_new_name/file name.txt (100), new_name/sub_new_name/hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), new_name/sub_new_name/zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1485
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsDirMove
Messages: Unexpected file "new_name/sub_new_name/zero-length-file"
fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3
fstest.go:295: Flushing the directory cache
fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3
fstest.go:295: Flushing the directory cache
2025/03/05 01:55:08 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:55:08 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:55:08 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 01:55:08 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:55:08 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:56:08 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:56:08 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:57:09 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:57:09 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:58:08 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:58:08 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 01:59:09 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 01:59:09 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 02:00:08 DEBUG : pacer: Reducing sleep to 45s
2025/03/05 02:01:08 DEBUG : pacer: Reducing sleep to 33.75s
2025/03/05 02:01:54 DEBUG : pacer: Reducing sleep to 25.3125s
2025/03/05 02:02:27 DEBUG : pacer: Reducing sleep to 18.984375s
2025/03/05 02:02:52 DEBUG : pacer: Reducing sleep to 14.23828125s
2025/03/05 02:03:11 DEBUG : pacer: Reducing sleep to 10.678710937s
fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3
fstest.go:295: Flushing the directory cache
fstest.go:299:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:299
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1499
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsDirMove
Messages: listing wrong, want
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100) got
file name.txt (100), hello? sausage/êé/Hello, 世界/ " ' @ < > & ? + ≠/z.txt (100), zero-length-file (0)
fstest.go:185:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:185
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:302
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1499
Error: Should be true
Test: TestIntegration/FsMkdir/FsPutFiles/FsDirMove
Messages: Unexpected file "zero-length-file"
2025/03/05 02:03:16 DEBUG : zoho root 'rclone-test-vavocad4niko': Purge remote
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsRmdirFull
2025/03/05 02:03:26 DEBUG : pacer: Reducing sleep to 8.009033202s
2025/03/05 02:03:36 DEBUG : pacer: Reducing sleep to 6.006774901s
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsPrecision
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectString
2025/03/05 02:03:44 DEBUG : pacer: Reducing sleep to 4.505081175s
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectFs
2025/03/05 02:03:50 DEBUG : pacer: Reducing sleep to 3.378810881s
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectRemote
2025/03/05 02:03:55 DEBUG : pacer: Reducing sleep to 2.53410816s
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectHashes
2025/03/05 02:03:58 DEBUG : pacer: Reducing sleep to 1.90058112s
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectModTime
2025/03/05 02:04:01 DEBUG : pacer: Reducing sleep to 1.42543584s
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMimeType
2025/03/05 02:04:03 DEBUG : pacer: Reducing sleep to 1.06907688s
fstests.go:1592: MimeType method not supported
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectMetadata
2025/03/05 02:04:04 DEBUG : pacer: Reducing sleep to 801.80766ms
fstests.go:1623: Metadata method not supported
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSetMetadata
2025/03/05 02:04:05 DEBUG : pacer: Reducing sleep to 601.355745ms
fstests.go:1694: SetMetadata method not supported
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSetModTime
2025/03/05 02:04:06 DEBUG : pacer: Reducing sleep to 451.016808ms
fstests.go:1751: can't set modified time
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectSize
2025/03/05 02:04:07 DEBUG : pacer: Reducing sleep to 338.262606ms
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpen
2025/03/05 02:04:07 DEBUG : pacer: Reducing sleep to 253.696954ms
2025/03/05 02:04:07 DEBUG : Couldn't parse Date: from server download.zoho.eu: "Wed, 05 Mar 2025 02:04:07 UTC": parsing time "Wed, 05 Mar 2025 02:04:07 UTC" as "Mon Jan _2 15:04:05 2006": cannot parse ", 05 Mar 2025 02:04:07 UTC" as " "
2025/03/05 02:04:07 ERROR : zoho: missing OAuth Scope. Run rclone config reconnect to fix this issue.
2025/03/05 02:04:07 DEBUG : pacer: Reducing sleep to 190.272715ms
fstests.go:287:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:287
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1772
Error: Received unexpected error:
HTTP error 401 (401 INVALID_OAUTHSCOPE) returned body: "{\"ERROR_MESSAGE\":\"INVALID_OAUTHSCOPE\",\"ERROR_CODE\":401}"
Test: TestIntegration/FsMkdir/FsPutFiles/ObjectOpen
Messages: readObject("file name.txt") limit=-1, options=[]
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenSeek
2025/03/05 02:04:08 DEBUG : pacer: Reducing sleep to 142.704536ms
2025/03/05 02:04:08 DEBUG : Couldn't parse Date: from server download.zoho.eu: "Wed, 05 Mar 2025 02:04:08 UTC": parsing time "Wed, 05 Mar 2025 02:04:08 UTC" as "Mon Jan _2 15:04:05 2006": cannot parse ", 05 Mar 2025 02:04:08 UTC" as " "
2025/03/05 02:04:08 ERROR : zoho: missing OAuth Scope. Run rclone config reconnect to fix this issue.
2025/03/05 02:04:08 DEBUG : pacer: Reducing sleep to 107.028402ms
fstests.go:287:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:287
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1779
Error: Received unexpected error:
HTTP error 401 (401 INVALID_OAUTHSCOPE) returned body: "{\"ERROR_MESSAGE\":\"INVALID_OAUTHSCOPE\",\"ERROR_CODE\":401}"
Test: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenSeek
Messages: readObject("file name.txt") limit=-1, options=[SeekOption(50)]
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectOpenRange
2025/03/05 02:04:08 DEBUG : pacer: Reducing sleep to 80.271301ms
2025/03/05 02:04:09 DEBUG : Couldn't parse Date: from server download.zoho.eu: "Wed, 05 Mar 2025 02:04:09 UTC": parsing time "Wed, 05 Mar 2025 02:04:09 UTC" as "Mon Jan _2 15:04:05 2006": cannot parse ", 05 Mar 2025 02:04:09 UTC" as " "
2025/03/05 02:04:09 ERROR : zoho: missing OAuth Scope. Run rclone config reconnect to fix this issue.
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 60.203475ms
fstests.go:287:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:287
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1798
Error: Received unexpected error:
HTTP error 401 (401 INVALID_OAUTHSCOPE) returned body: "{\"ERROR_MESSAGE\":\"INVALID_OAUTHSCOPE\",\"ERROR_CODE\":401}"
Test: TestIntegration/FsMkdir/FsPutFiles/ObjectOpenRange
Messages: readObject("file name.txt") limit=-1, options=[RangeOption(5,15)]
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectPartialRead
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 45.152606ms
2025/03/05 02:04:09 DEBUG : Couldn't parse Date: from server download.zoho.eu: "Wed, 05 Mar 2025 02:04:09 UTC": parsing time "Wed, 05 Mar 2025 02:04:09 UTC" as "Mon Jan _2 15:04:05 2006": cannot parse ", 05 Mar 2025 02:04:09 UTC" as " "
2025/03/05 02:04:09 ERROR : zoho: missing OAuth Scope. Run rclone config reconnect to fix this issue.
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 33.864454ms
fstests.go:287:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:287
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1809
Error: Received unexpected error:
HTTP error 401 (401 INVALID_OAUTHSCOPE) returned body: "{\"ERROR_MESSAGE\":\"INVALID_OAUTHSCOPE\",\"ERROR_CODE\":401}"
Test: TestIntegration/FsMkdir/FsPutFiles/ObjectPartialRead
Messages: readObject("file name.txt") limit=50, options=[]
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectUpdate
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 25.39834ms
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 19.048755ms
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 14.286566ms
2025/03/05 02:04:09 DEBUG : Couldn't parse Date: from server download.zoho.eu: "Wed, 05 Mar 2025 02:04:09 UTC": parsing time "Wed, 05 Mar 2025 02:04:09 UTC" as "Mon Jan _2 15:04:05 2006": cannot parse ", 05 Mar 2025 02:04:09 UTC" as " "
2025/03/05 02:04:09 ERROR : zoho: missing OAuth Scope. Run rclone config reconnect to fix this issue.
2025/03/05 02:04:09 DEBUG : pacer: Reducing sleep to 10.714924ms
fstests.go:287:
Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:287
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1840
Error: Received unexpected error:
HTTP error 401 (401 INVALID_OAUTHSCOPE) returned body: "{\"ERROR_MESSAGE\":\"INVALID_OAUTHSCOPE\",\"ERROR_CODE\":401}"
Test: TestIntegration/FsMkdir/FsPutFiles/ObjectUpdate
Messages: readObject("file name.txt") limit=-1, options=[]
=== RUN TestIntegration/FsMkdir/FsPutFiles/ObjectStorable
2025/03/05 02:04:10 DEBUG : pacer: Reducing sleep to 10ms
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFile
2025/03/05 02:04:10 DEBUG : Creating backend with remote "TestZoho:rclone-test-qokowik7wibo/hello? sausage/êé/Hello, 世界/ \" ' @ < > & ? + ≠/z.txt"
2025/03/05 02:04:10 DEBUG : Config file has changed externally - reloading
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFile/FsRoot
=== RUN TestIntegration/FsMkdir/FsPutFiles/FsIsFileNotFound
2025/03/05 02:04:11 DEBUG : Creating backend with remote "TestZoho:rclone-test-qokowik7wibo/not found.txt"
2025/03/05 02:04:11 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 02:04:11 DEBUG : pacer: low level retry 1/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 02:04:11 DEBUG : pacer: Rate limited, increasing sleep to 1m0s
2025/03/05 02:04:11 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 02:04:11 DEBUG : pacer: low level retry 2/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 02:05:11 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 02:05:11 DEBUG : pacer: low level retry 3/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 02:06:11 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 02:06:11 DEBUG : pacer: low level retry 4/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 02:07:11 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 02:07:11 DEBUG : pacer: low level retry 5/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
2025/03/05 02:08:11 DEBUG : Too many requests. Trying again in 60 seconds.
2025/03/05 02:08:11 DEBUG : pacer: low level retry 6/10 (error HTTP error 429 (429 Too Many Requests) returned body: "{\"errors\":[{\"id\":\"F7008\",\"title\":\"Request rate limit exceeded. Please retry again later.\"}]}\n")
panic: test timed out after 1h0m0s
running tests:
TestIntegration (1h0m0s)
TestIntegration/FsMkdir (59m59s)
TestIntegration/FsMkdir/FsPutFiles (32m49s)
TestIntegration/FsMkdir/FsPutFiles/FsIsFileNotFound (4m1s)
goroutine 3140 [running]:
testing.(*M).startAlarm.func1()
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2373 +0x385
created by time.goFunc
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/time/sleep.go:215 +0x2d
goroutine 1 [chan receive, 59 minutes]:
testing.(*T).Run(0xc000338000, {0xc00fd2?, 0x0?}, 0xc6f178)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1751 +0x3ab
testing.runTests.func1(0xc000338000)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2168 +0x37
testing.tRunner(0xc000338000, 0xc0000f9c70)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4
testing.runTests(0xc0002e5020, {0x11d18f0, 0x1, 0x1}, {0x474930?, 0x47459a?, 0x11f87c0?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2166 +0x43d
testing.(*M).Run(0xc000207180)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:2034 +0x64a
main.main()
_testmain.go:47 +0x9b
goroutine 8 [chan receive, 59 minutes]:
testing.(*T).Run(0xc0003381a0, {0xbf9c24?, 0xc000356e00?}, 0xc000482000)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1751 +0x3ab
github.com/rclone/rclone/fstest/fstests.Run(0xc0003381a0, 0xc0002b7520)
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:584 +0x1065
github.com/rclone/rclone/backend/zoho_test.TestIntegration(0xc0003381a0)
/home/rclone/go/src/github.com/rclone/rclone/backend/zoho/zoho_test.go:13 +0x58
testing.tRunner(0xc0003381a0, 0xc6f178)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4
created by testing.(*T).Run in goroutine 1
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1743 +0x390
goroutine 10 [syscall, 59 minutes]:
os/signal.signal_recv()
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/sigqueue.go:152 +0x29
os/signal.loop()
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/os/signal/signal_unix.go:23 +0x13
created by os/signal.Notify.func1.1 in goroutine 8
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/os/signal/signal.go:151 +0x1f
goroutine 11 [chan receive, 59 minutes]:
github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler.func1()
/home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:24 +0x27
created by github.com/rclone/rclone/fs/accounting.(*tokenBucket).startSignalHandler in goroutine 8
/home/rclone/go/src/github.com/rclone/rclone/fs/accounting/accounting_unix.go:21 +0xa7
goroutine 22 [select]:
github.com/rclone/rclone/fs/accounting.(*StatsInfo).averageLoop(0xc000104380)
/home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:339 +0x13d
created by github.com/rclone/rclone/fs/accounting.(*StatsInfo)._startAverageLoop in goroutine 8
/home/rclone/go/src/github.com/rclone/rclone/fs/accounting/stats.go:404 +0xb6
goroutine 82 [chan receive, 34 minutes]:
testing.(*T).Run(0xc000486000, {0xbfcffd?, 0x0?}, 0xc000000240)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1751 +0x3ab
github.com/rclone/rclone/fstest/fstests.Run.func13(0xc000486000)
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:951 +0xbd1
testing.tRunner(0xc000486000, 0xc000482000)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4
created by testing.(*T).Run in goroutine 8
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1743 +0x390
goroutine 1229 [chan receive, 4 minutes]:
testing.(*T).Run(0xc0004869c0, {0xc026ed?, 0xc0004869c0?}, 0xc000358040)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1751 +0x3ab
github.com/rclone/rclone/fstest/fstests.Run.func13.14(0xc0004869c0)
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1889 +0x1e19
testing.tRunner(0xc0004869c0, 0xc000000240)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4
created by testing.(*T).Run in goroutine 82
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1743 +0x390
goroutine 3070 [sleep]:
time.Sleep(0xdf8475800)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/time.go:285 +0xf2
github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall.func1(0xc00046e758?)
/home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:167 +0x1c
created by github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall in goroutine 3024
/home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:166 +0xef
goroutine 3155 [IO wait]:
internal/poll.runtime_pollWait(0x7f6c247294a8, 0x72)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/runtime/netpoll.go:351 +0x85
internal/poll.(*pollDesc).wait(0xc000356080?, 0xc000226000?, 0x0)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27
internal/poll.(*pollDesc).waitRead(...)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000356080, {0xc000226000, 0x1000, 0x1000})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/internal/poll/fd_unix.go:165 +0x27a
net.(*netFD).Read(0xc000356080, {0xc000226000?, 0x41cab6?, 0x2?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/fd_posix.go:55 +0x25
net.(*conn).Read(0xc00014a038, {0xc000226000?, 0x1000100000000?, 0x7f6c24732458?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/net.go:189 +0x45
github.com/rclone/rclone/fs/fshttp.(*timeoutConn).Read(0xc000216018, {0xc000226000?, 0x18?, 0xba6a60?})
/home/rclone/go/src/github.com/rclone/rclone/fs/fshttp/dialer.go:111 +0x2c
crypto/tls.(*atLeastReader).Read(0xc000216378, {0xc000226000?, 0x0?, 0xc000216378?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:809 +0x3b
bytes.(*Buffer).ReadFrom(0xc000004d38, {0xd30860, 0xc000216378})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/bytes/buffer.go:211 +0x98
crypto/tls.(*Conn).readFromUntil(0xc000004a88, {0x7f6c2c597a18, 0xc000216018}, 0xc00014ea10?)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:831 +0xde
crypto/tls.(*Conn).readRecordOrCCS(0xc000004a88, 0x0)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:629 +0x3cf
crypto/tls.(*Conn).readRecord(...)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:591
crypto/tls.(*Conn).Read(0xc000004a88, {0xc00030c000, 0x1000, 0xc00014eca0?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/crypto/tls/conn.go:1385 +0x150
bufio.(*Reader).Read(0xc0003a3680, {0xc000178040, 0x9, 0x11cefc0?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/bufio/bufio.go:241 +0x197
io.ReadAtLeast({0xd2f700, 0xc0003a3680}, {0xc000178040, 0x9, 0x9}, 0x9)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/io/io.go:335 +0x90
io.ReadFull(...)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/io/io.go:354
net/http.http2readFrameHeader({0xc000178040, 0x9, 0x25ad20?}, {0xd2f700?, 0xc0003a3680?})
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:1642 +0x65
net/http.(*http2Framer).ReadFrame(0xc000178000)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:1909 +0x85
net/http.(*http2clientConnReadLoop).run(0xc00014efa8)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:9496 +0xda
net/http.(*http2ClientConn).readLoop(0xc000002000)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:9392 +0x7c
created by net/http.(*http2Transport).newClientConn in goroutine 3154
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/net/http/h2_bundle.go:8006 +0xd1b
goroutine 3024 [chan receive]:
github.com/rclone/rclone/lib/pacer.(*Pacer).beginCall(0xc000414360)
/home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:159 +0x25
github.com/rclone/rclone/lib/pacer.(*Pacer).call(0xc000414360, 0xc0003deac0, 0xa)
/home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:196 +0x5c
github.com/rclone/rclone/lib/pacer.(*Pacer).Call(0xc000414360, 0xc0003deac0)
/home/rclone/go/src/github.com/rclone/rclone/lib/pacer/pacer.go:216 +0x92
github.com/rclone/rclone/backend/zoho.(*Fs).listAll(0xc0003fc580, {0xd35df0, 0x1219ea0}, {0xc000489560, 0x25}, 0x0, 0x1, 0xc00004dbe0)
/home/rclone/go/src/github.com/rclone/rclone/backend/zoho/zoho.go:592 +0x41a
github.com/rclone/rclone/backend/zoho.(*Fs).readMetaDataForPath(0xc0003fc580, {0xd35df0, 0x1219ea0}, {0xc0002bb012?, 0x1?})
/home/rclone/go/src/github.com/rclone/rclone/backend/zoho/zoho.go:458 +0x112
github.com/rclone/rclone/backend/zoho.(*Object).readMetaData(0xc0000a2320, {0xd35df0?, 0x1219ea0?})
/home/rclone/go/src/github.com/rclone/rclone/backend/zoho/zoho.go:1306 +0x3e
github.com/rclone/rclone/backend/zoho.(*Fs).newObjectWithInfo(0xc0003fc580, {0xd35df0, 0x1219ea0}, {0xc0002bb012, 0xd}, 0x0)
/home/rclone/go/src/github.com/rclone/rclone/backend/zoho/zoho.go:730 +0x10d
github.com/rclone/rclone/backend/zoho.NewFs({0xd35df0, 0x1219ea0}, {0xc0002baff0, 0x8}, {0xc0002baff9, 0x26}, {0xd328a8, 0xc00025a270})
/home/rclone/go/src/github.com/rclone/rclone/backend/zoho/zoho.go:549 +0x6be
github.com/rclone/rclone/fs.NewFs({0xd35df0, 0x1219ea0}, {0xc0002baff0, 0x2f})
/home/rclone/go/src/github.com/rclone/rclone/fs/newfs.go:68 +0x33b
github.com/rclone/rclone/fstest/fstests.Run.func13.14.41(0xc000486340)
/home/rclone/go/src/github.com/rclone/rclone/fstest/fstests/fstests.go:1892 +0x68
testing.tRunner(0xc000486340, 0xc000358040)
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1690 +0xf4
created by testing.(*T).Run in goroutine 1229
/home/rclone/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.23.0.linux-amd64/src/testing/testing.go:1743 +0x390
exit status 2
FAIL github.com/rclone/rclone/backend/zoho 3600.013s
"go test -v -timeout 1h0m0s -remote TestZoho: -verbose" - Finished ERROR in 1h0m0.591586334s (try 1/5): exit status 1: Failed []