"./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^TestDirMove$'" - Starting (try 5/5) 2024/11/05 04:37:40 DEBUG : Creating backend with remote "TestWebdavOwncloud:rclone-test-nuquzib4nusu" 2024/11/05 04:37:40 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/05 04:37:40 DEBUG : Setting type="webdav" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_TYPE 2024/11/05 04:37:40 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2024/11/05 04:37:40 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2024/11/05 04:37:40 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2024/11/05 04:37:40 DEBUG : Setting pass="YqEzTzyBvxKIH6ugRwvjy9BrC0IrPHPr8Rtdyl12DkUx8ig" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2024/11/05 04:37:40 DEBUG : TestWebdavOwncloud: detected overridden config - adding "{4ixH-}" suffix to name 2024/11/05 04:37:40 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2024/11/05 04:37:40 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2024/11/05 04:37:40 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2024/11/05 04:37:40 DEBUG : Setting pass="YqEzTzyBvxKIH6ugRwvjy9BrC0IrPHPr8Rtdyl12DkUx8ig" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2024/11/05 04:37:40 DEBUG : found headers: 2024/11/05 04:37:40 DEBUG : Creating backend with remote "/tmp/rclone2264323702" === RUN TestDirMove run.go:180: Remote "webdav root 'rclone-test-nuquzib4nusu'", Local "Local file system at /tmp/rclone2264323702", Modify Window "1s" 2024/11/05 04:37:40 DEBUG : A1/one: Update will use the normal upload strategy (no chunks) 2024/11/05 04:37:41 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2024/11/05 04:37:41 DEBUG : A1/B1/three: Update will use the normal upload strategy (no chunks) 2024/11/05 04:37:41 DEBUG : A1/B1/C1/four: Update will use the normal upload strategy (no chunks) 2024/11/05 04:37:42 DEBUG : A1/B1/C2/five: Update will use the normal upload strategy (no chunks) 2024/11/05 04:37:42 DEBUG : A1/B2: Making directory 2024/11/05 04:37:42 DEBUG : A1/B1/C3: Making directory 2024/11/05 04:37:45 INFO : A2/B1/C2/five: Moved (server-side) to: A3/B1/C2/five 2024/11/05 04:37:45 INFO : A2/B1/C1/four: Moved (server-side) to: A3/B1/C1/four 2024/11/05 04:37:45 INFO : A2/two: Moved (server-side) to: A3/two 2024/11/05 04:37:45 INFO : A2/B1/three: Moved (server-side) to: A3/B1/three 2024/11/05 04:37:45 INFO : A2/one: Moved (server-side) to: A3/one 2024/11/05 04:37:45 DEBUG : pacer: low level retry 1/10 (error An exception occurred while executing 'UPDATE "oc_file_locks" SET "lock" = 0 WHERE "key" = ? AND "lock" = -1' with params ["files\/9fe6123f3ba2596cb184fb458fa8e88c"]: SQLSTATE[HY000]: General error: 5 database is locked: Doctrine\DBAL\Exception\LockWaitTimeoutException: 500 Internal Server Error) 2024/11/05 04:37:45 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/05 04:37:45 DEBUG : pacer: Reducing sleep to 15ms operations_test.go:1405: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1405 Error: Received unexpected error: RenameDir rmdir: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden Test: TestDirMove 2024/11/05 04:37:45 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/05 04:37:45 DEBUG : pacer: Reducing sleep to 10ms 2024/11/05 04:37:47 DEBUG : pacer: low level retry 1/10 (error An exception occurred while executing 'UPDATE "oc_file_locks" SET "lock" = 0 WHERE "key" = ? AND "lock" = -1' with params ["files\/a8e7e43e3444c0427168be0142f12d50"]: SQLSTATE[HY000]: General error: 5 database is locked: Doctrine\DBAL\Exception\LockWaitTimeoutException: 500 Internal Server Error) 2024/11/05 04:37:47 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/05 04:37:47 DEBUG : pacer: Reducing sleep to 15ms run.go:125: removing dir "A2/B1/C3" failed - try 1/3: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden 2024/11/05 04:37:49 DEBUG : pacer: Reducing sleep to 11.25ms run.go:125: removing dir "A2/B1/C3" failed - try 2/3: directory not found 2024/11/05 04:37:50 DEBUG : pacer: Reducing sleep to 10ms run.go:125: removing dir "A2/B1/C3" failed - try 3/3: directory not found run.go:128: removing dir "A2/B1/C3" failed: directory not found 2024/11/05 04:37:51 DEBUG : pacer: low level retry 1/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:51 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/05 04:37:51 DEBUG : pacer: low level retry 2/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:51 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/05 04:37:51 DEBUG : pacer: low level retry 3/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:51 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/05 04:37:52 DEBUG : pacer: low level retry 4/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:52 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/11/05 04:37:52 DEBUG : pacer: low level retry 5/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:52 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/11/05 04:37:52 DEBUG : pacer: low level retry 6/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:52 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/11/05 04:37:52 DEBUG : pacer: low level retry 7/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:52 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/11/05 04:37:53 DEBUG : pacer: low level retry 8/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:53 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/05 04:37:54 DEBUG : pacer: low level retry 9/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:37:56 DEBUG : pacer: low level retry 10/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A2/B1" failed - try 1/3: rmdir failed: "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/05 04:37:58 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/05 04:38:00 DEBUG : pacer: low level retry 1/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:00 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/05 04:38:02 DEBUG : pacer: low level retry 2/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:04 DEBUG : pacer: low level retry 3/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:06 DEBUG : pacer: low level retry 4/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:08 DEBUG : pacer: low level retry 5/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:10 DEBUG : pacer: low level retry 6/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:12 DEBUG : pacer: low level retry 7/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:14 DEBUG : pacer: low level retry 8/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:16 DEBUG : pacer: low level retry 9/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:18 DEBUG : pacer: low level retry 10/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A2/B1" failed - try 2/3: rmdir failed: "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/05 04:38:20 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/05 04:38:22 DEBUG : pacer: low level retry 1/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:22 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/05 04:38:23 DEBUG : pacer: low level retry 2/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:25 DEBUG : pacer: low level retry 3/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:27 DEBUG : pacer: low level retry 4/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:29 DEBUG : pacer: low level retry 5/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:31 DEBUG : pacer: low level retry 6/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:33 DEBUG : pacer: low level retry 7/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:35 DEBUG : pacer: low level retry 8/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:37 DEBUG : pacer: low level retry 9/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:39 DEBUG : pacer: low level retry 10/10 (error "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A2/B1" failed - try 3/3: rmdir failed: "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:128: removing dir "A2/B1" failed: rmdir failed: "rclone-test-nuquzib4nusu/A2/B1" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/05 04:38:41 DEBUG : pacer: Reducing sleep to 1.5s run.go:125: removing dir "A2" failed - try 1/3: directory not empty 2024/11/05 04:38:43 DEBUG : pacer: Reducing sleep to 1.125s run.go:125: removing dir "A2" failed - try 2/3: directory not empty 2024/11/05 04:38:45 DEBUG : pacer: Reducing sleep to 843.75ms run.go:125: removing dir "A2" failed - try 3/3: directory not empty run.go:128: removing dir "A2" failed: directory not empty 2024/11/05 04:38:46 DEBUG : pacer: Reducing sleep to 632.8125ms 2024/11/05 04:38:46 DEBUG : pacer: Reducing sleep to 474.609375ms 2024/11/05 04:38:47 DEBUG : pacer: Reducing sleep to 355.957031ms fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/11/05 04:38:48 DEBUG : pacer: Reducing sleep to 266.967773ms 2024/11/05 04:38:49 DEBUG : pacer: Reducing sleep to 200.225829ms 2024/11/05 04:38:49 DEBUG : pacer: Reducing sleep to 150.169371ms fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/11/05 04:38:51 DEBUG : pacer: Reducing sleep to 112.627028ms 2024/11/05 04:38:51 DEBUG : pacer: Reducing sleep to 84.470271ms 2024/11/05 04:38:51 DEBUG : pacer: Reducing sleep to 63.352703ms fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:321 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1175 /usr/local/go/src/testing/testing.go:1353 /usr/local/go/src/testing/testing.go:1683 /usr/local/go/src/runtime/panic.go:626 /usr/local/go/src/testing/testing.go:1005 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1405 Error: Not equal: expected: []string{} actual : []string{"A2", "A2/B1"} Diff: --- Expected +++ Actual @@ -1,2 +1,4 @@ -([]string) { +([]string) (len=2) { + (string) (len=2) "A2", + (string) (len=5) "A2/B1" } Test: TestDirMove Messages: directories --- FAIL: TestDirMove (75.01s) FAIL 2024/11/05 04:38:55 DEBUG : webdav root 'rclone-test-nuquzib4nusu': Purge remote 2024/11/05 04:38:55 DEBUG : pacer: low level retry 1/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:55 DEBUG : pacer: Rate limited, increasing sleep to 126.705406ms 2024/11/05 04:38:55 DEBUG : pacer: low level retry 2/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:55 DEBUG : pacer: Rate limited, increasing sleep to 253.410812ms 2024/11/05 04:38:55 DEBUG : pacer: low level retry 3/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:55 DEBUG : pacer: Rate limited, increasing sleep to 506.821624ms 2024/11/05 04:38:56 DEBUG : pacer: low level retry 4/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:56 DEBUG : pacer: Rate limited, increasing sleep to 1.013643248s 2024/11/05 04:38:56 DEBUG : pacer: low level retry 5/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:56 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/05 04:38:57 DEBUG : pacer: low level retry 6/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:38:59 DEBUG : pacer: low level retry 7/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:39:01 DEBUG : pacer: low level retry 8/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:39:03 DEBUG : pacer: low level retry 9/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:39:05 DEBUG : pacer: low level retry 10/10 (error "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/05 04:39:05 NOTICE: purge failed: rmdir failed: "rclone-test-nuquzib4nusu" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked "./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^TestDirMove$'" - Finished ERROR in 1m25.263658843s (try 5/5): exit status 1: Failed [TestDirMove]