"./operations.test -test.v -test.timeout 1h0m0s -remote TestShade: -verbose -test.run '^(TestMaxDeleteSize|TestRmdirsNoLeaveRoot)$'" - Starting (try 2/5)
2026/09/22 03:34:04 DEBUG : Creating backend with remote "TestShade:rclone-test-goqujof3pazu"
2026/09/22 03:34:04 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/09/22 03:34:04 DEBUG : Creating new ShadeFS backend with drive: cf193d00-c783-4bab-aa7a-fd84b3700d27
2026/09/22 03:34:04 DEBUG : Creating backend with remote "/tmp/rclone1349668551"
=== RUN   TestMaxDeleteSize
    run.go:198: Remote "Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-goqujof3pazu", Local "Local file system at /tmp/rclone1349668551", Modify Window "876000h0m0s"
2026/09/22 03:34:05 DEBUG : small: multipart upload: starting chunk 0 size 10 offset 0/10
2026/09/22 03:34:07 DEBUG : medium: multipart upload: starting chunk 0 size 60 offset 0/60
2026/09/22 03:34:10 DEBUG : large: multipart upload: starting chunk 0 size 100 offset 0/100
2026/09/22 03:34:12 DEBUG : Waiting for deletions to finish
2026/09/22 03:34:12 ERROR : large: Got fatal error on delete: --max-delete-size threshold reached
2026/09/22 03:34:12 INFO  : small: Deleted
2026/09/22 03:34:12 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:12 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:12 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:12 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/09/22 03:34:12 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:12 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/09/22 03:34:13 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:13 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/22 03:34:13 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:13 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/22 03:34:13 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:13 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/22 03:34:13 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:13 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/09/22 03:34:14 DEBUG : pacer: low level retry 8/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:14 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/22 03:34:15 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/22 03:34:15 INFO  : medium: Deleted
2026/09/22 03:34:18 DEBUG : pacer: Reducing sleep to 640ms
2026/09/22 03:34:19 DEBUG : pacer: Reducing sleep to 320ms
2026/09/22 03:34:20 DEBUG : pacer: Reducing sleep to 160ms
2026/09/22 03:34:20 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:20 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/22 03:34:20 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:20 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/22 03:34:20 DEBUG : pacer: Reducing sleep to 320ms
2026/09/22 03:34:21 DEBUG : pacer: Reducing sleep to 160ms
2026/09/22 03:34:21 DEBUG : pacer: Reducing sleep to 80ms
--- PASS: TestMaxDeleteSize (16.98s)
=== RUN   TestRmdirsNoLeaveRoot
    run.go:198: Remote "Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-goqujof3pazu", Local "Local file system at /tmp/rclone1349668551", Modify Window "876000h0m0s"
2026/09/22 03:34:22 DEBUG : pacer: Reducing sleep to 40ms
2026/09/22 03:34:22 DEBUG : pacer: Reducing sleep to 20ms
2026/09/22 03:34:22 DEBUG : pacer: Reducing sleep to 10ms
2026/09/22 03:34:22 DEBUG : A1/B1/C1/one: multipart upload: starting chunk 0 size 3 offset 0/3
2026/09/22 03:34:24 INFO  : A2: Making directory
2026/09/22 03:34:24 INFO  : A1/B2: Making directory
2026/09/22 03:34:24 INFO  : A1/B2/C2: Making directory
2026/09/22 03:34:25 INFO  : A1/B1/C3: Making directory
2026/09/22 03:34:25 INFO  : A3: Making directory
2026/09/22 03:34:25 INFO  : A3/B3: Making directory
2026/09/22 03:34:25 INFO  : A3/B3/C4: Making directory
2026/09/22 03:34:26 DEBUG : A1/two: multipart upload: starting chunk 0 size 3 offset 0/3
2026/09/22 03:34:28 DEBUG : removing 1 level 3 directories
2026/09/22 03:34:28 INFO  : A3/B3/C4: Removing directory
2026/09/22 03:34:29 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:29 DEBUG : pacer: Reducing sleep to 10ms
2026/09/22 03:34:29 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:29 DEBUG : pacer: Reducing sleep to 10ms
2026/09/22 03:34:29 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:29 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:29 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:29 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/09/22 03:34:30 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:30 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/09/22 03:34:30 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:30 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/22 03:34:30 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:30 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/22 03:34:30 DEBUG : pacer: low level retry 8/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:30 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/22 03:34:30 DEBUG : pacer: low level retry 9/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:30 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/09/22 03:34:31 DEBUG : pacer: low level retry 10/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:31 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/22 03:34:31 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-goqujof3pazu: Error from List call: HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND"
2026/09/22 03:34:31 ERROR : A3/B3: error listing: directory not found
2026/09/22 03:34:32 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/22 03:34:35 DEBUG : pacer: Reducing sleep to 640ms
2026/09/22 03:34:36 DEBUG : pacer: Reducing sleep to 320ms
2026/09/22 03:34:37 DEBUG : pacer: Reducing sleep to 160ms
2026/09/22 03:34:37 DEBUG : pacer: Reducing sleep to 80ms
2026/09/22 03:34:37 DEBUG : pacer: Reducing sleep to 40ms
2026/09/22 03:34:37 DEBUG : pacer: Reducing sleep to 20ms
2026/09/22 03:34:37 DEBUG : pacer: Reducing sleep to 10ms
2026/09/22 03:34:38 DEBUG : removing 2 level 3 directories
2026/09/22 03:34:38 INFO  : A1/B2/C2: Removing directory
2026/09/22 03:34:38 INFO  : A1/B1/C3: Removing directory
2026/09/22 03:34:38 DEBUG : removing 2 level 2 directories
2026/09/22 03:34:38 INFO  : A3/B3: Removing directory
2026/09/22 03:34:38 INFO  : A1/B2: Removing directory
2026/09/22 03:34:38 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:38 DEBUG : pacer: Reducing sleep to 10ms
2026/09/22 03:34:38 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:38 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:38 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:38 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/09/22 03:34:38 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:38 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/09/22 03:34:39 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:39 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/22 03:34:39 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:39 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/22 03:34:39 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:39 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/22 03:34:39 DEBUG : pacer: low level retry 8/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:39 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/09/22 03:34:40 DEBUG : pacer: low level retry 9/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:40 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/22 03:34:41 DEBUG : pacer: low level retry 10/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:41 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/09/22 03:34:41 ERROR : A1/B2: Failed to rmdir: HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND"
2026/09/22 03:34:41 DEBUG : removing 2 level 1 directories
2026/09/22 03:34:41 INFO  : A3: Removing directory
2026/09/22 03:34:41 INFO  : A2: Removing directory
2026/09/22 03:34:44 DEBUG : pacer: Reducing sleep to 2.56s
2026/09/22 03:34:49 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/22 03:34:51 DEBUG : pacer: Reducing sleep to 640ms
2026/09/22 03:34:53 DEBUG : pacer: Reducing sleep to 320ms
    operations_test.go:783: 
        	Error Trace:	/home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:783
        	Error:      	Received unexpected error:
        	            	failed to remove directories: HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND"
        	Test:       	TestRmdirsNoLeaveRoot
2026/09/22 03:34:53 DEBUG : pacer: Reducing sleep to 160ms
2026/09/22 03:34:54 DEBUG : pacer: Reducing sleep to 80ms
2026/09/22 03:34:54 DEBUG : pacer: Reducing sleep to 40ms
2026/09/22 03:34:54 DEBUG : pacer: Reducing sleep to 20ms
2026/09/22 03:34:54 DEBUG : pacer: Reducing sleep to 10ms
2026/09/22 03:34:55 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:55 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/22 03:34:55 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:55 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/09/22 03:34:55 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:55 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/09/22 03:34:55 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:55 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/22 03:34:55 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:55 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/22 03:34:56 DEBUG : pacer: Reducing sleep to 160ms
2026/09/22 03:34:56 DEBUG : pacer: Reducing sleep to 80ms
2026/09/22 03:34:56 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:56 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/22 03:34:56 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:56 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/22 03:34:56 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:56 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/22 03:34:57 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:57 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/09/22 03:34:57 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:57 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/22 03:34:59 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:34:59 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/09/22 03:35:01 DEBUG : pacer: Reducing sleep to 2.56s
2026/09/22 03:35:06 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/22 03:35:09 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:35:09 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/22 03:35:10 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:35:10 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/09/22 03:35:13 DEBUG : pacer: Reducing sleep to 2.56s
2026/09/22 03:35:18 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/22 03:35:20 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:35:20 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/22 03:35:22 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/22 03:35:22 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/09/22 03:35:24 DEBUG : pacer: Reducing sleep to 2.56s
--- FAIL: TestRmdirsNoLeaveRoot (62.75s)
FAIL
2026/09/22 03:35:29 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/22 03:35:29 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-goqujof3pazu: Purge dir ""
2026/09/22 03:35:32 DEBUG : pacer: Reducing sleep to 640ms
2026/09/22 03:35:33 DEBUG : pacer: Reducing sleep to 320ms
"./operations.test -test.v -test.timeout 1h0m0s -remote TestShade: -verbose -test.run '^(TestMaxDeleteSize|TestRmdirsNoLeaveRoot)$'" - Finished ERROR in 1m28.943210565s (try 2/5): exit status 1: Failed [TestRmdirsNoLeaveRoot]