"./sync.test -test.v -test.timeout 1h0m0s -remote TestShade: -verbose -test.run '^(TestSyncConcurrentDelete|TestSyncDeleteDuring)$'" - Starting (try 2/5)
2026/09/14 06:14:00 DEBUG : Creating backend with remote "TestShade:rclone-test-winavud4ziwu"
2026/09/14 06:14:00 DEBUG : Using config file from "/home/rclone/.rclone.conf"
2026/09/14 06:14:00 DEBUG : Creating new ShadeFS backend with drive: cf193d00-c783-4bab-aa7a-fd84b3700d27
2026/09/14 06:14:00 DEBUG : Creating backend with remote "/tmp/rclone2969870259"
=== RUN   TestSyncDeleteDuring
    run.go:198: Remote "Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu", Local "Local file system at /tmp/rclone2969870259", Modify Window "876000h0m0s"
2026/09/14 06:14:01 DEBUG : potato: multipart upload: starting chunk 0 size 21 offset 0/21
2026/09/14 06:14:03 DEBUG : empty space: multipart upload: starting chunk 0 size 1 offset 0/1
2026/09/14 06:14:04 DEBUG : Waiting for deletions to finish
2026/09/14 06:14:05 DEBUG : potato2: Need to transfer - File not found at Destination
2026/09/14 06:14:05 DEBUG : empty space: size = 1 OK
2026/09/14 06:14:05 DEBUG : empty space: Sizes identical
2026/09/14 06:14:05 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu: Waiting for checks to finish
2026/09/14 06:14:05 DEBUG : empty space: Unchanged skipping
2026/09/14 06:14:05 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu: Waiting for transfers to finish
2026/09/14 06:14:05 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:05 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/14 06:14:05 DEBUG : pacer: Reducing sleep to 10ms
2026/09/14 06:14:05 INFO  : potato: Deleted
2026/09/14 06:14:05 DEBUG : potato2: multipart upload: starting chunk 0 size 60 offset 0/60
2026/09/14 06:14:06 DEBUG : potato2: size = 60 OK
2026/09/14 06:14:06 INFO  : potato2: Copied (new)
2026/09/14 06:14:07 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:07 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/14 06:14:07 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:07 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/09/14 06:14:07 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:07 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/09/14 06:14:07 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:07 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/14 06:14:08 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:08 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/14 06:14:08 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:08 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/14 06:14:08 DEBUG : pacer: low level retry 7/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:08 DEBUG : pacer: Rate limited, increasing sleep to 1.28s
2026/09/14 06:14:09 DEBUG : pacer: low level retry 8/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:09 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/14 06:14:10 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/14 06:14:13 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:13 DEBUG : pacer: Rate limited, increasing sleep to 2.56s
2026/09/14 06:14:14 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:14:14 DEBUG : pacer: Rate limited, increasing sleep to 5.12s
2026/09/14 06:14:16 DEBUG : pacer: Reducing sleep to 2.56s
--- PASS: TestSyncDeleteDuring (16.31s)
=== RUN   TestSyncConcurrentDelete
    run.go:198: Remote "Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu", Local "Local file system at /tmp/rclone2969870259", Modify Window "876000h0m0s"
2026/09/14 06:14:22 DEBUG : pacer: Reducing sleep to 1.28s
2026/09/14 06:14:22 DEBUG : both0: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:24 DEBUG : pacer: Reducing sleep to 640ms
2026/09/14 06:14:26 DEBUG : pacer: Reducing sleep to 320ms
2026/09/14 06:14:27 DEBUG : pacer: Reducing sleep to 160ms
2026/09/14 06:14:27 DEBUG : pacer: Reducing sleep to 80ms
2026/09/14 06:14:27 DEBUG : only0: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:27 DEBUG : pacer: Reducing sleep to 40ms
2026/09/14 06:14:28 DEBUG : pacer: Reducing sleep to 20ms
2026/09/14 06:14:29 DEBUG : pacer: Reducing sleep to 10ms
2026/09/14 06:14:29 DEBUG : both1: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:31 DEBUG : only1: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:33 DEBUG : both2: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:35 DEBUG : only2: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:37 DEBUG : both3: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:39 DEBUG : only3: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:41 DEBUG : both4: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:43 DEBUG : only4: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:45 DEBUG : both5: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:47 DEBUG : only5: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:48 DEBUG : both6: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:50 DEBUG : only6: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:52 DEBUG : both7: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:54 DEBUG : only7: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:56 DEBUG : both8: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:14:58 DEBUG : only8: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:00 DEBUG : both9: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:02 DEBUG : only9: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:04 DEBUG : both10: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:06 DEBUG : only10: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:08 DEBUG : both11: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:10 DEBUG : only11: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:12 DEBUG : both12: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:14 DEBUG : only12: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:16 DEBUG : both13: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:18 DEBUG : only13: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:20 DEBUG : both14: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:22 DEBUG : only14: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:24 DEBUG : both15: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:26 DEBUG : only15: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:28 DEBUG : both16: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:30 DEBUG : only16: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:32 DEBUG : both17: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:34 DEBUG : only17: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:36 DEBUG : both18: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:38 DEBUG : only18: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:40 DEBUG : both19: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:42 DEBUG : only19: multipart upload: starting chunk 0 size 6 offset 0/6
2026/09/14 06:15:44 DEBUG : both10: size = 6 OK
2026/09/14 06:15:44 DEBUG : both10: Sizes identical
2026/09/14 06:15:44 DEBUG : both0: size = 6 OK
2026/09/14 06:15:44 DEBUG : both11: size = 6 OK
2026/09/14 06:15:44 DEBUG : both0: Sizes identical
2026/09/14 06:15:44 DEBUG : both11: Sizes identical
2026/09/14 06:15:44 DEBUG : both12: size = 6 OK
2026/09/14 06:15:44 DEBUG : both12: Sizes identical
2026/09/14 06:15:44 DEBUG : both0: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both13: size = 6 OK
2026/09/14 06:15:44 DEBUG : both13: Sizes identical
2026/09/14 06:15:44 DEBUG : both13: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both14: size = 6 OK
2026/09/14 06:15:44 DEBUG : both14: Sizes identical
2026/09/14 06:15:44 DEBUG : both14: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both15: size = 6 OK
2026/09/14 06:15:44 DEBUG : both15: Sizes identical
2026/09/14 06:15:44 DEBUG : both15: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both16: size = 6 OK
2026/09/14 06:15:44 DEBUG : both16: Sizes identical
2026/09/14 06:15:44 DEBUG : both16: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both17: size = 6 OK
2026/09/14 06:15:44 DEBUG : both17: Sizes identical
2026/09/14 06:15:44 DEBUG : both17: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both18: size = 6 OK
2026/09/14 06:15:44 DEBUG : both18: Sizes identical
2026/09/14 06:15:44 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu: Waiting for checks to finish
2026/09/14 06:15:44 DEBUG : both11: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both19: size = 6 OK
2026/09/14 06:15:44 DEBUG : both19: Sizes identical
2026/09/14 06:15:44 DEBUG : both19: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both1: size = 6 OK
2026/09/14 06:15:44 DEBUG : both1: Sizes identical
2026/09/14 06:15:44 DEBUG : both12: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both2: size = 6 OK
2026/09/14 06:15:44 DEBUG : both2: Sizes identical
2026/09/14 06:15:44 DEBUG : both10: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both3: size = 6 OK
2026/09/14 06:15:44 DEBUG : both3: Sizes identical
2026/09/14 06:15:44 DEBUG : both18: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both4: size = 6 OK
2026/09/14 06:15:44 DEBUG : both4: Sizes identical
2026/09/14 06:15:44 DEBUG : both3: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both5: size = 6 OK
2026/09/14 06:15:44 DEBUG : both5: Sizes identical
2026/09/14 06:15:44 DEBUG : both5: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both6: size = 6 OK
2026/09/14 06:15:44 DEBUG : both6: Sizes identical
2026/09/14 06:15:44 DEBUG : both6: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both7: size = 6 OK
2026/09/14 06:15:44 DEBUG : both7: Sizes identical
2026/09/14 06:15:44 DEBUG : both1: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both8: size = 6 OK
2026/09/14 06:15:44 DEBUG : both8: Sizes identical
2026/09/14 06:15:44 DEBUG : both8: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both9: size = 6 OK
2026/09/14 06:15:44 DEBUG : both9: Sizes identical
2026/09/14 06:15:44 DEBUG : both2: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both4: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both7: Unchanged skipping
2026/09/14 06:15:44 DEBUG : both9: Unchanged skipping
2026/09/14 06:15:44 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu: Waiting for transfers to finish
2026/09/14 06:15:44 DEBUG : Waiting for deletions to finish
2026/09/14 06:15:44 INFO  : only4: Deleted
2026/09/14 06:15:44 INFO  : only5: Deleted
2026/09/14 06:15:44 INFO  : only11: Deleted
2026/09/14 06:15:44 INFO  : only13: Deleted
2026/09/14 06:15:44 INFO  : only15: Deleted
2026/09/14 06:15:44 INFO  : only16: Deleted
2026/09/14 06:15:44 INFO  : only19: Deleted
2026/09/14 06:15:44 INFO  : only1: Deleted
2026/09/14 06:15:44 INFO  : only0: Deleted
2026/09/14 06:15:44 INFO  : only10: Deleted
2026/09/14 06:15:45 INFO  : only14: Deleted
2026/09/14 06:15:45 INFO  : only12: Deleted
2026/09/14 06:15:45 INFO  : only2: Deleted
2026/09/14 06:15:45 INFO  : only8: Deleted
2026/09/14 06:15:45 INFO  : only17: Deleted
2026/09/14 06:15:45 INFO  : only18: Deleted
2026/09/14 06:15:45 INFO  : only3: Deleted
2026/09/14 06:15:45 INFO  : only6: Deleted
2026/09/14 06:15:45 INFO  : only7: Deleted
2026/09/14 06:15:45 INFO  : only9: Deleted
2026/09/14 06:15:48 DEBUG : pacer: low level retry 1/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:15:48 DEBUG : pacer: Rate limited, increasing sleep to 20ms
2026/09/14 06:15:49 DEBUG : pacer: low level retry 2/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:15:49 DEBUG : pacer: Rate limited, increasing sleep to 40ms
2026/09/14 06:15:49 DEBUG : pacer: low level retry 3/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:15:49 DEBUG : pacer: Rate limited, increasing sleep to 80ms
2026/09/14 06:15:49 DEBUG : pacer: low level retry 4/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:15:49 DEBUG : pacer: Rate limited, increasing sleep to 160ms
2026/09/14 06:15:49 DEBUG : pacer: low level retry 5/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:15:49 DEBUG : pacer: Rate limited, increasing sleep to 320ms
2026/09/14 06:15:49 DEBUG : pacer: low level retry 6/10 (error HTTP error 500 (500 Internal Server Error) returned body: "ENTRY_NOT_FOUND")
2026/09/14 06:15:49 DEBUG : pacer: Rate limited, increasing sleep to 640ms
2026/09/14 06:15:49 DEBUG : pacer: Reducing sleep to 320ms
--- PASS: TestSyncConcurrentDelete (93.05s)
PASS
2026/09/14 06:15:50 DEBUG : pacer: Reducing sleep to 160ms
2026/09/14 06:15:50 DEBUG : Shade drive cf193d00-c783-4bab-aa7a-fd84b3700d27 path rclone-test-winavud4ziwu: Purge dir ""
2026/09/14 06:15:50 DEBUG : pacer: Reducing sleep to 80ms
2026/09/14 06:15:51 DEBUG : pacer: Reducing sleep to 40ms
"./sync.test -test.v -test.timeout 1h0m0s -remote TestShade: -verbose -test.run '^(TestSyncConcurrentDelete|TestSyncDeleteDuring)$'" - Finished OK in 1m50.735286645s (try 2/5)