"./vfs.test -test.v -test.timeout 1h0m0s -remote TestShade: -verbose -test.run '^TestDirHandleMethods$'" - Starting (try 2/5)
2026/07/25 02:02:06 DEBUG : Creating backend with remote "TestShade:rclone-test-ruziqug3qisa"
2026/07/25 02:02:06 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/07/25 02:02:06 DEBUG : Creating new ShadeFS backend with drive: cf193d00-c783-4bab-aa7a-fd84b3700d27
2026/07/25 02:02:06 DEBUG : Creating backend with remote "/tmp/rclone1843654969"
=== RUN   TestDirHandleMethods
    run.go:198: Remote "Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa", Local "Local file system at /tmp/rclone1843654969", Modify Window "876000h0m0s"
2026/07/25 02:02:06 INFO  : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa: poll-interval is not supported by this remote
2026/07/25 02:02:06 NOTICE: Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa: --vfs-cache-mode writes or full is recommended for this remote as it can't stream
2026/07/25 02:02:07 DEBUG : dir/file1: multipart upload: starting chunk 0 size 14 offset 0/14
2026/07/25 02:02:08 DEBUG : pacer: low level retry 1/10 (error EOF)
2026/07/25 02:02:08 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/07/25 02:02:08 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:08 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/07/25 02:02:09 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:09 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/07/25 02:02:09 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:09 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/07/25 02:02:09 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:09 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/07/25 02:02:10 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:10 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/07/25 02:02:10 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:10 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/07/25 02:02:10 DEBUG : pacer: low level retry 8/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:10 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/07/25 02:02:12 DEBUG : pacer: low level retry 9/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:12 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/07/25 02:02:14 DEBUG : pacer: low level retry 10/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:14 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/25 02:02:14 DEBUG : dir/file1: Cancelling multipart upload
2026/07/25 02:02:19 DEBUG : pacer: Reducing sleep to 5.12s
    run.go:299: Retry Put of "dir/file1" to Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa: 1/10 (multipart upload: failed to finalise: failed to complete multipart upload: HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:30 DEBUG : pacer: Reducing sleep to 2.56s
2026/07/25 02:02:30 DEBUG : dir/file1: multipart upload: starting chunk 0 size 14 offset 0/14
2026/07/25 02:02:35 DEBUG : pacer: Reducing sleep to 1.28s
2026/07/25 02:02:37 DEBUG : pacer: Reducing sleep to 640ms
2026/07/25 02:02:39 DEBUG : pacer: low level retry 1/10 (error EOF)
2026/07/25 02:02:39 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/07/25 02:02:40 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:40 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/07/25 02:02:41 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:41 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/07/25 02:02:43 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:43 DEBUG : pacer: Rate limited, increasing sleep to 10.24s
2026/07/25 02:02:49 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:49 DEBUG : pacer: Rate limited, increasing sleep to 20.48s
2026/07/25 02:02:59 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:02:59 DEBUG : pacer: Rate limited, increasing sleep to 40.96s
2026/07/25 02:03:19 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:03:19 DEBUG : pacer: Rate limited, increasing sleep to 1m21.92s
2026/07/25 02:04:00 DEBUG : pacer: low level retry 8/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:04:00 DEBUG : pacer: Rate limited, increasing sleep to 2m43.84s
2026/07/25 02:05:22 DEBUG : pacer: low level retry 9/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:05:22 DEBUG : pacer: Rate limited, increasing sleep to 5m0s
2026/07/25 02:08:06 DEBUG : pacer: low level retry 10/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:08:06 DEBUG : dir/file1: Cancelling multipart upload
2026/07/25 02:12:06 DEBUG : forgetting directory cache
2026/07/25 02:13:06 DEBUG : pacer: Reducing sleep to 2m30s
    run.go:299: Retry Put of "dir/file1" to Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa: 2/10 (multipart upload: failed to finalise: failed to complete multipart upload: HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:18:06 DEBUG : pacer: Reducing sleep to 1m15s
2026/07/25 02:18:06 DEBUG : dir/file1: multipart upload: starting chunk 0 size 14 offset 0/14
2026/07/25 02:20:36 DEBUG : pacer: Reducing sleep to 37.5s
2026/07/25 02:21:51 DEBUG : pacer: Reducing sleep to 18.75s
2026/07/25 02:22:29 DEBUG : pacer: low level retry 1/10 (error EOF)
2026/07/25 02:22:29 DEBUG : pacer: Rate limited, increasing sleep to 37.5s
2026/07/25 02:22:47 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:22:47 DEBUG : pacer: Rate limited, increasing sleep to 1m15s
2026/07/25 02:23:25 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:23:25 DEBUG : pacer: Rate limited, increasing sleep to 2m30s
2026/07/25 02:24:40 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:24:40 DEBUG : pacer: Rate limited, increasing sleep to 5m0s
2026/07/25 02:27:10 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:32:10 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:37:10 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "Internal Server Error")
2026/07/25 02:42:10 DEBUG : pacer: Reducing sleep to 2m30s
2026/07/25 02:42:10 DEBUG : dir/file1: Cancelling multipart upload
2026/07/25 02:47:10 DEBUG : pacer: Reducing sleep to 1m15s
2026/07/25 02:47:10 DEBUG : Saving config "token" in section "TestShade" of the config file
2026/07/25 02:47:10 DEBUG : Config file has changed externally - reloading
2026/07/25 02:47:10 DEBUG : Saving config "token_expiry" in section "TestShade" of the config file
2026/07/25 02:49:40 DEBUG : pacer: Reducing sleep to 37.5s
    run.go:303: Failed to put "dir/file1" to "Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa": multipart upload: failed to finalise: failed to complete multipart upload: HTTP error 400 (400 Bad Request) returned body: "Invalid token"
2026/07/25 02:49:40 DEBUG : WaitForWriters: timeout=30s
2026/07/25 02:49:40 DEBUG : Looking for writers
2026/07/25 02:49:40 DEBUG : >WaitForWriters: 
2026/07/25 02:50:55 DEBUG : pacer: Reducing sleep to 18.75s
2026/07/25 02:51:32 DEBUG : pacer: Reducing sleep to 9.375s
2026/07/25 02:51:51 DEBUG : pacer: Reducing sleep to 4.6875s
2026/07/25 02:52:00 DEBUG : pacer: Reducing sleep to 2.34375s
2026/07/25 02:52:05 DEBUG : pacer: Reducing sleep to 1.171875s
2026/07/25 02:52:07 DEBUG : pacer: Reducing sleep to 585.9375ms
--- FAIL: TestDirHandleMethods (3001.64s)
FAIL
2026/07/25 02:52:09 DEBUG : pacer: Reducing sleep to 292.96875ms
2026/07/25 02:52:09 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-ruziqug3qisa: Purge dir ""
2026/07/25 02:52:09 DEBUG : pacer: Reducing sleep to 146.484375ms
2026/07/25 02:52:10 DEBUG : pacer: Reducing sleep to 73.242187ms
"./vfs.test -test.v -test.timeout 1h0m0s -remote TestShade: -verbose -test.run '^TestDirHandleMethods$'" - Finished ERROR in 50m3.999895238s (try 2/5): exit status 1: Failed [TestDirHandleMethods]