"./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^(TestDirMove|TestRmdirsNoLeaveRoot)$'" - Starting (try 5/5) 2025/11/18 01:18:28 DEBUG : Creating backend with remote "TestWebdavOwncloud:rclone-test-cayiyur2fiqu" 2025/11/18 01:18:28 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/11/18 01:18:28 DEBUG : Setting type="webdav" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_TYPE 2025/11/18 01:18:28 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2025/11/18 01:18:28 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2025/11/18 01:18:28 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2025/11/18 01:18:28 DEBUG : Setting pass="2FqA5gp8_mJzWqUAj6fsp54D6Mnm8dZS7Y_YhbLETi-2GH0" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2025/11/18 01:18:28 DEBUG : TestWebdavOwncloud: detected overridden config - adding "{6BUOW}" suffix to name 2025/11/18 01:18:28 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2025/11/18 01:18:28 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2025/11/18 01:18:28 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2025/11/18 01:18:28 DEBUG : Setting pass="2FqA5gp8_mJzWqUAj6fsp54D6Mnm8dZS7Y_YhbLETi-2GH0" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2025/11/18 01:18:28 DEBUG : found headers: 2025/11/18 01:18:29 DEBUG : Creating backend with remote "/tmp/rclone3623473158" === RUN TestRmdirsNoLeaveRoot run.go:185: Remote "webdav root 'rclone-test-cayiyur2fiqu'", Local "Local file system at /tmp/rclone3623473158", Modify Window "1s" 2025/11/18 01:18:30 DEBUG : A1/B1/C1/one: Update will use the normal upload strategy (no chunks) 2025/11/18 01:18:31 INFO : A2: Making directory 2025/11/18 01:18:31 INFO : A1/B2: Making directory 2025/11/18 01:18:31 INFO : A1/B2/C2: Making directory 2025/11/18 01:18:31 INFO : A1/B1/C3: Making directory 2025/11/18 01:18:31 INFO : A3: Making directory 2025/11/18 01:18:31 INFO : A3/B3: Making directory 2025/11/18 01:18:32 INFO : A3/B3/C4: Making directory 2025/11/18 01:18:32 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2025/11/18 01:18:33 DEBUG : removing 1 level 3 directories 2025/11/18 01:18:33 INFO : A3/B3/C4: Removing directory 2025/11/18 01:18:34 DEBUG : removing 2 level 3 directories 2025/11/18 01:18:34 INFO : A1/B2/C2: Removing directory 2025/11/18 01:18:34 INFO : A1/B1/C3: Removing directory 2025/11/18 01:18:34 DEBUG : pacer: low level retry 1/10 (error An exception occurred while executing 'UPDATE "oc_file_locks" SET "lock" = 0 WHERE "key" = ? AND "lock" = -1' with params ["files\/7afa2cea2d19a7c35df7d451681592e4"]: SQLSTATE[HY000]: General error: 5 database is locked: Doctrine\DBAL\Exception\LockWaitTimeoutException: 500 Internal Server Error) 2025/11/18 01:18:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/18 01:18:34 DEBUG : pacer: Reducing sleep to 15ms 2025/11/18 01:18:34 DEBUG : pacer: Reducing sleep to 11.25ms 2025/11/18 01:18:34 ERROR : A1/B2/C2: Failed to rmdir: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden 2025/11/18 01:18:34 DEBUG : removing 2 level 2 directories 2025/11/18 01:18:34 INFO : A3/B3: Removing directory 2025/11/18 01:18:34 INFO : A1/B2: Removing directory 2025/11/18 01:18:34 DEBUG : pacer: Reducing sleep to 10ms 2025/11/18 01:18:34 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:34 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/18 01:18:34 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:34 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/11/18 01:18:34 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:34 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/11/18 01:18:35 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:35 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/11/18 01:18:35 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:35 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/11/18 01:18:35 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:35 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/11/18 01:18:35 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:35 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/11/18 01:18:36 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:36 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:18:37 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:39 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:39 ERROR : A1/B2: Failed to rmdir: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:18:39 DEBUG : removing 2 level 1 directories 2025/11/18 01:18:39 INFO : A3: Removing directory 2025/11/18 01:18:39 INFO : A2: Removing directory 2025/11/18 01:18:41 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:18:43 DEBUG : pacer: Reducing sleep to 1.125s 2025/11/18 01:18:45 DEBUG : pacer: Reducing sleep to 843.75ms 2025/11/18 01:18:46 DEBUG : pacer: Reducing sleep to 632.8125ms operations_test.go:705: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 Error: Received unexpected error: failed to remove directories: 2 errors: last error: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked Test: TestRmdirsNoLeaveRoot 2025/11/18 01:18:47 DEBUG : pacer: Reducing sleep to 474.609375ms 2025/11/18 01:18:47 DEBUG : pacer: Reducing sleep to 355.957031ms 2025/11/18 01:18:48 DEBUG : pacer: Reducing sleep to 266.967773ms 2025/11/18 01:18:48 DEBUG : pacer: Reducing sleep to 200.225829ms 2025/11/18 01:18:48 DEBUG : pacer: Reducing sleep to 150.169371ms 2025/11/18 01:18:48 DEBUG : pacer: Reducing sleep to 112.627028ms 2025/11/18 01:18:49 DEBUG : pacer: Reducing sleep to 84.470271ms 2025/11/18 01:18:49 DEBUG : pacer: Reducing sleep to 63.352703ms 2025/11/18 01:18:49 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:49 DEBUG : pacer: Rate limited, increasing sleep to 126.705406ms 2025/11/18 01:18:49 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:49 DEBUG : pacer: Rate limited, increasing sleep to 253.410812ms 2025/11/18 01:18:49 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:49 DEBUG : pacer: Rate limited, increasing sleep to 506.821624ms 2025/11/18 01:18:49 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:49 DEBUG : pacer: Rate limited, increasing sleep to 1.013643248s 2025/11/18 01:18:50 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:50 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:18:51 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:53 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:55 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:57 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:18:59 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:130: removing dir "A1/B2" failed - try 1/3: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:19:01 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:19:03 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:03 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:19:04 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:06 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:08 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:10 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:12 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:14 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:16 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:18 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:20 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:130: removing dir "A1/B2" failed - try 2/3: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:19:22 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:19:24 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:24 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:19:26 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:28 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:30 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:32 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:34 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:36 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:38 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:40 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:19:42 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:130: removing dir "A1/B2" failed - try 3/3: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:133: removing dir "A1/B2" failed: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:19:44 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:19:46 DEBUG : pacer: Reducing sleep to 1.125s 2025/11/18 01:19:47 DEBUG : pacer: Reducing sleep to 843.75ms 2025/11/18 01:19:49 DEBUG : pacer: Reducing sleep to 632.8125ms 2025/11/18 01:19:49 DEBUG : pacer: Reducing sleep to 474.609375ms run.go:130: removing dir "A1" failed - try 1/3: directory not empty 2025/11/18 01:19:50 DEBUG : pacer: Reducing sleep to 355.957031ms run.go:130: removing dir "A1" failed - try 2/3: directory not empty 2025/11/18 01:19:52 DEBUG : pacer: Reducing sleep to 266.967773ms run.go:130: removing dir "A1" failed - try 3/3: directory not empty run.go:133: removing dir "A1" failed: directory not empty 2025/11/18 01:19:53 DEBUG : pacer: Reducing sleep to 200.225829ms 2025/11/18 01:19:53 DEBUG : pacer: Reducing sleep to 150.169371ms 2025/11/18 01:19:53 DEBUG : pacer: Reducing sleep to 112.627028ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 2025/11/18 01:19:54 DEBUG : pacer: Reducing sleep to 84.470271ms 2025/11/18 01:19:54 DEBUG : pacer: Reducing sleep to 63.352703ms 2025/11/18 01:19:54 DEBUG : pacer: Reducing sleep to 47.514527ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 2025/11/18 01:19:57 DEBUG : pacer: Reducing sleep to 35.635895ms 2025/11/18 01:19:57 DEBUG : pacer: Reducing sleep to 26.726921ms 2025/11/18 01:19:57 DEBUG : pacer: Reducing sleep to 20.04519ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 Error: Not equal: expected: []string{} actual : []string{"A1", "A1/B2"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=2) "A1", + (string) (len=5) "A1/B2" } Test: TestRmdirsNoLeaveRoot Messages: directories --- FAIL: TestRmdirsNoLeaveRoot (91.22s) === RUN TestDirMove run.go:185: Remote "webdav root 'rclone-test-cayiyur2fiqu'", Local "Local file system at /tmp/rclone3623473158", Modify Window "1s" 2025/11/18 01:20:01 DEBUG : pacer: Reducing sleep to 15.033892ms 2025/11/18 01:20:01 DEBUG : pacer: Reducing sleep to 11.275419ms 2025/11/18 01:20:01 DEBUG : A1/one: Update will use the normal upload strategy (no chunks) 2025/11/18 01:20:01 DEBUG : pacer: Reducing sleep to 10ms 2025/11/18 01:20:01 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2025/11/18 01:20:02 DEBUG : A1/B1/three: Update will use the normal upload strategy (no chunks) 2025/11/18 01:20:02 DEBUG : A1/B1/C1/four: Update will use the normal upload strategy (no chunks) 2025/11/18 01:20:02 DEBUG : A1/B1/C2/five: Update will use the normal upload strategy (no chunks) 2025/11/18 01:20:03 INFO : A1/B2: Making directory 2025/11/18 01:20:03 INFO : A1/B1/C3: Making directory 2025/11/18 01:20:04 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:04 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/18 01:20:04 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:04 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/11/18 01:20:04 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:04 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/11/18 01:20:04 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:04 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/11/18 01:20:04 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:04 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/11/18 01:20:04 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:04 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/11/18 01:20:05 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:05 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/11/18 01:20:05 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:05 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:20:07 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2025/11/18 01:20:09 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) operations_test.go:1388: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1388 Error: Received unexpected error: DirMove MOVE call failed: "rclone-test-cayiyur2fiqu/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error Test: TestDirMove 2025/11/18 01:20:11 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:20:13 DEBUG : pacer: Reducing sleep to 1.125s 2025/11/18 01:20:14 DEBUG : pacer: Reducing sleep to 843.75ms 2025/11/18 01:20:15 DEBUG : pacer: Reducing sleep to 632.8125ms 2025/11/18 01:20:16 DEBUG : pacer: Reducing sleep to 474.609375ms 2025/11/18 01:20:17 DEBUG : pacer: Reducing sleep to 355.957031ms 2025/11/18 01:20:17 DEBUG : pacer: Reducing sleep to 266.967773ms 2025/11/18 01:20:17 DEBUG : pacer: Reducing sleep to 200.225829ms 2025/11/18 01:20:18 DEBUG : pacer: Reducing sleep to 150.169371ms 2025/11/18 01:20:18 DEBUG : pacer: Reducing sleep to 112.627028ms 2025/11/18 01:20:18 DEBUG : pacer: Reducing sleep to 84.470271ms 2025/11/18 01:20:18 DEBUG : pacer: Reducing sleep to 63.352703ms 2025/11/18 01:20:18 DEBUG : pacer: Reducing sleep to 47.514527ms 2025/11/18 01:20:19 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:19 DEBUG : pacer: Rate limited, increasing sleep to 95.029054ms 2025/11/18 01:20:19 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:19 DEBUG : pacer: Rate limited, increasing sleep to 190.058108ms 2025/11/18 01:20:19 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:19 DEBUG : pacer: Rate limited, increasing sleep to 380.116216ms 2025/11/18 01:20:19 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:19 DEBUG : pacer: Rate limited, increasing sleep to 760.232432ms 2025/11/18 01:20:19 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:19 DEBUG : pacer: Rate limited, increasing sleep to 1.520464864s 2025/11/18 01:20:20 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:20 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:20:22 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:24 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:26 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:28 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:130: removing dir "A1/B2" failed - try 1/3: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:20:30 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:20:32 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:32 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:20:33 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:35 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:37 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:39 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:41 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:43 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:45 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:47 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:49 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:130: removing dir "A1/B2" failed - try 2/3: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:20:51 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:20:53 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:53 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:20:55 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:57 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:20:59 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:01 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:03 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:05 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:07 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:09 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:11 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:130: removing dir "A1/B2" failed - try 3/3: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:133: removing dir "A1/B2" failed: rmdir failed: "rclone-test-cayiyur2fiqu/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2025/11/18 01:21:13 DEBUG : pacer: Reducing sleep to 1.5s 2025/11/18 01:21:15 DEBUG : pacer: Reducing sleep to 1.125s 2025/11/18 01:21:16 DEBUG : pacer: Reducing sleep to 843.75ms 2025/11/18 01:21:17 DEBUG : pacer: Reducing sleep to 632.8125ms 2025/11/18 01:21:18 DEBUG : pacer: Reducing sleep to 474.609375ms 2025/11/18 01:21:19 DEBUG : pacer: Reducing sleep to 355.957031ms 2025/11/18 01:21:19 DEBUG : pacer: Reducing sleep to 266.967773ms 2025/11/18 01:21:20 DEBUG : pacer: Reducing sleep to 200.225829ms 2025/11/18 01:21:20 DEBUG : pacer: Reducing sleep to 150.169371ms run.go:130: removing dir "A1" failed - try 1/3: directory not empty 2025/11/18 01:21:21 DEBUG : pacer: Reducing sleep to 112.627028ms run.go:130: removing dir "A1" failed - try 2/3: directory not empty 2025/11/18 01:21:22 DEBUG : pacer: Reducing sleep to 84.470271ms run.go:130: removing dir "A1" failed - try 3/3: directory not empty run.go:133: removing dir "A1" failed: directory not empty 2025/11/18 01:21:23 DEBUG : pacer: Reducing sleep to 63.352703ms 2025/11/18 01:21:23 DEBUG : pacer: Reducing sleep to 47.514527ms 2025/11/18 01:21:23 DEBUG : pacer: Reducing sleep to 35.635895ms fstest.go:298: Sleeping for 1s for list eventual consistency: 1/3 2025/11/18 01:21:24 DEBUG : pacer: Reducing sleep to 26.726921ms 2025/11/18 01:21:25 DEBUG : pacer: Reducing sleep to 20.04519ms 2025/11/18 01:21:25 DEBUG : pacer: Reducing sleep to 15.033892ms fstest.go:298: Sleeping for 2s for list eventual consistency: 2/3 2025/11/18 01:21:27 DEBUG : pacer: Reducing sleep to 11.275419ms 2025/11/18 01:21:27 DEBUG : pacer: Reducing sleep to 10ms fstest.go:298: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:327: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:327 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:338 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:178 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:393 /usr/local/go/src/testing/testing.go:1211 /usr/local/go/src/testing/testing.go:1445 /usr/local/go/src/testing/testing.go:1786 /usr/local/go/src/runtime/panic.go:636 /usr/local/go/src/testing/testing.go:1041 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1388 Error: Not equal: expected: []string{} actual : []string{"A1", "A1/B2"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=2) "A1", + (string) (len=5) "A1/B2" } Test: TestDirMove Messages: directories --- FAIL: TestDirMove (90.27s) FAIL 2025/11/18 01:21:31 DEBUG : webdav root 'rclone-test-cayiyur2fiqu': Purge remote 2025/11/18 01:21:31 DEBUG : pacer: low level retry 1/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:31 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/11/18 01:21:31 DEBUG : pacer: low level retry 2/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:31 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/11/18 01:21:31 DEBUG : pacer: low level retry 3/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:31 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/11/18 01:21:31 DEBUG : pacer: low level retry 4/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:31 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/11/18 01:21:31 DEBUG : pacer: low level retry 5/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:31 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2025/11/18 01:21:32 DEBUG : pacer: low level retry 6/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:32 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2025/11/18 01:21:32 DEBUG : pacer: low level retry 7/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:32 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2025/11/18 01:21:33 DEBUG : pacer: low level retry 8/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:33 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/11/18 01:21:34 DEBUG : pacer: low level retry 9/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:36 DEBUG : pacer: low level retry 10/10 (error "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2025/11/18 01:21:36 NOTICE: purge failed: rmdir failed: "rclone-test-cayiyur2fiqu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked "./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^(TestDirMove|TestRmdirsNoLeaveRoot)$'" - Finished ERROR in 3m7.545037211s (try 5/5): exit status 1: Failed [TestRmdirsNoLeaveRoot TestDirMove]