"./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^(TestDirMove|TestRmdirsNoLeaveRoot)$'" - Starting (try 3/5) 2024/10/22 02:15:02 DEBUG : Creating backend with remote "TestWebdavOwncloud:rclone-test-vojopiw2coze" 2024/10/22 02:15:02 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/10/22 02:15:02 DEBUG : Setting type="webdav" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_TYPE 2024/10/22 02:15:02 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2024/10/22 02:15:02 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2024/10/22 02:15:02 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2024/10/22 02:15:02 DEBUG : Setting pass="hMruegN8Q1mwGa4w0nHq28KKOnZfpEuXz3iYDFAEHTlwfnY" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2024/10/22 02:15:02 DEBUG : TestWebdavOwncloud: detected overridden config - adding "{dzMTS}" suffix to name 2024/10/22 02:15:02 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2024/10/22 02:15:02 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2024/10/22 02:15:02 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2024/10/22 02:15:02 DEBUG : Setting pass="hMruegN8Q1mwGa4w0nHq28KKOnZfpEuXz3iYDFAEHTlwfnY" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2024/10/22 02:15:02 DEBUG : found headers: 2024/10/22 02:15:03 DEBUG : Creating backend with remote "/tmp/rclone3607499918" === RUN TestRmdirsNoLeaveRoot run.go:180: Remote "webdav root 'rclone-test-vojopiw2coze'", Local "Local file system at /tmp/rclone3607499918", Modify Window "1s" 2024/10/22 02:15:04 DEBUG : A1/B1/C1/one: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:04 DEBUG : A2: Making directory 2024/10/22 02:15:04 DEBUG : A1/B2: Making directory 2024/10/22 02:15:04 DEBUG : A1/B2/C2: Making directory 2024/10/22 02:15:04 DEBUG : A1/B1/C3: Making directory 2024/10/22 02:15:05 DEBUG : A3: Making directory 2024/10/22 02:15:05 DEBUG : A3/B3: Making directory 2024/10/22 02:15:05 DEBUG : A3/B3/C4: Making directory 2024/10/22 02:15:05 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:06 DEBUG : removing 1 level 3 directories 2024/10/22 02:15:06 INFO : A3/B3/C4: Removing directory 2024/10/22 02:15:07 DEBUG : removing 2 level 3 directories 2024/10/22 02:15:07 INFO : A1/B2/C2: Removing directory 2024/10/22 02:15:07 INFO : A1/B1/C3: Removing directory 2024/10/22 02:15:07 DEBUG : removing 2 level 2 directories 2024/10/22 02:15:07 INFO : A3/B3: Removing directory 2024/10/22 02:15:07 INFO : A1/B2: Removing directory 2024/10/22 02:15:07 DEBUG : removing 2 level 1 directories 2024/10/22 02:15:07 INFO : A3: Removing directory 2024/10/22 02:15:07 INFO : A2: Removing directory 2024/10/22 02:15:07 DEBUG : pacer: low level retry 1/10 (error An exception occurred while executing 'UPDATE "oc_file_locks" SET "lock" = 0 WHERE "key" = ? AND "lock" = -1' with params ["files\/fb7d64c30ee06cf6eaae5f681be15892"]: SQLSTATE[HY000]: General error: 5 database is locked: Doctrine\DBAL\Exception\LockWaitTimeoutException: 500 Internal Server Error) 2024/10/22 02:15:07 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/10/22 02:15:07 DEBUG : pacer: Reducing sleep to 15ms 2024/10/22 02:15:07 DEBUG : pacer: Reducing sleep to 11.25ms 2024/10/22 02:15:07 ERROR : A2: Failed to rmdir: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden operations_test.go:705: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 Error: Received unexpected error: failed to remove directories: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden Test: TestRmdirsNoLeaveRoot 2024/10/22 02:15:07 DEBUG : pacer: Reducing sleep to 10ms --- FAIL: TestRmdirsNoLeaveRoot (5.43s) === RUN TestDirMove run.go:180: Remote "webdav root 'rclone-test-vojopiw2coze'", Local "Local file system at /tmp/rclone3607499918", Modify Window "1s" 2024/10/22 02:15:09 DEBUG : A1/one: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:09 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:09 DEBUG : A1/B1/three: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:10 DEBUG : A1/B1/C1/four: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:10 DEBUG : A1/B1/C2/five: Update will use the normal upload strategy (no chunks) 2024/10/22 02:15:10 DEBUG : A1/B2: Making directory 2024/10/22 02:15:10 DEBUG : A1/B1/C3: Making directory 2024/10/22 02:15:11 DEBUG : pacer: low level retry 1/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:11 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/10/22 02:15:11 DEBUG : pacer: low level retry 2/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:11 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/10/22 02:15:11 DEBUG : pacer: low level retry 3/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:11 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/10/22 02:15:11 DEBUG : pacer: low level retry 4/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:11 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/10/22 02:15:11 DEBUG : pacer: low level retry 5/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:11 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/10/22 02:15:11 DEBUG : pacer: low level retry 6/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:11 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/10/22 02:15:12 DEBUG : pacer: low level retry 7/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:12 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/10/22 02:15:12 DEBUG : pacer: low level retry 8/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:12 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/10/22 02:15:14 DEBUG : pacer: low level retry 9/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/10/22 02:15:16 DEBUG : pacer: low level retry 10/10 (error "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error) operations_test.go:1380: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1380 Error: Received unexpected error: DirMove MOVE call failed: "rclone-test-vojopiw2coze/A2" is locked: OCP\Lock\LockedException: 500 Internal Server Error Test: TestDirMove 2024/10/22 02:15:18 DEBUG : pacer: Reducing sleep to 1.5s 2024/10/22 02:15:20 DEBUG : pacer: Reducing sleep to 1.125s 2024/10/22 02:15:21 DEBUG : pacer: Reducing sleep to 843.75ms 2024/10/22 02:15:22 DEBUG : pacer: Reducing sleep to 632.8125ms 2024/10/22 02:15:23 DEBUG : pacer: Reducing sleep to 474.609375ms 2024/10/22 02:15:24 DEBUG : pacer: Reducing sleep to 355.957031ms 2024/10/22 02:15:24 DEBUG : pacer: Reducing sleep to 266.967773ms 2024/10/22 02:15:25 DEBUG : pacer: Reducing sleep to 200.225829ms 2024/10/22 02:15:25 DEBUG : pacer: Reducing sleep to 150.169371ms 2024/10/22 02:15:25 DEBUG : pacer: Reducing sleep to 112.627028ms 2024/10/22 02:15:25 DEBUG : pacer: Reducing sleep to 84.470271ms 2024/10/22 02:15:25 DEBUG : pacer: Reducing sleep to 63.352703ms 2024/10/22 02:15:25 DEBUG : pacer: Reducing sleep to 47.514527ms 2024/10/22 02:15:26 DEBUG : pacer: Reducing sleep to 35.635895ms 2024/10/22 02:15:26 DEBUG : pacer: Reducing sleep to 26.726921ms 2024/10/22 02:15:26 DEBUG : pacer: Reducing sleep to 20.04519ms 2024/10/22 02:15:26 DEBUG : pacer: Reducing sleep to 15.033892ms 2024/10/22 02:15:26 DEBUG : pacer: Reducing sleep to 11.275419ms 2024/10/22 02:15:26 DEBUG : pacer: Reducing sleep to 10ms --- FAIL: TestDirMove (18.16s) FAIL 2024/10/22 02:15:27 DEBUG : webdav root 'rclone-test-vojopiw2coze': Purge remote 2024/10/22 02:15:27 DEBUG : pacer: low level retry 1/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/10/22 02:15:27 DEBUG : pacer: low level retry 2/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:27 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/10/22 02:15:27 DEBUG : pacer: low level retry 3/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:27 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/10/22 02:15:27 DEBUG : pacer: low level retry 4/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:27 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/10/22 02:15:27 DEBUG : pacer: low level retry 5/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:27 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/10/22 02:15:27 DEBUG : pacer: low level retry 6/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:27 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/10/22 02:15:28 DEBUG : pacer: low level retry 7/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:28 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/10/22 02:15:28 DEBUG : pacer: low level retry 8/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:28 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/10/22 02:15:29 DEBUG : pacer: low level retry 9/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:31 DEBUG : pacer: low level retry 10/10 (error "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/10/22 02:15:31 NOTICE: purge failed: rmdir failed: "rclone-test-vojopiw2coze" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked "./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^(TestDirMove|TestRmdirsNoLeaveRoot)$'" - Finished ERROR in 29.251081724s (try 3/5): exit status 1: Failed [TestRmdirsNoLeaveRoot TestDirMove]