"./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^(TestDirMove|TestRmdirsNoLeaveRoot)$'" - Starting (try 5/5) 2024/11/22 03:01:10 DEBUG : Creating backend with remote "TestWebdavOwncloud:rclone-test-kufeyut7tejo" 2024/11/22 03:01:10 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2024/11/22 03:01:10 DEBUG : Setting type="webdav" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_TYPE 2024/11/22 03:01:10 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2024/11/22 03:01:10 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2024/11/22 03:01:10 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2024/11/22 03:01:10 DEBUG : Setting pass="W80x0N3RMbhwoih54FcJHfcU-MKOeMhquCpsYwJRhIOwES0" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2024/11/22 03:01:10 DEBUG : TestWebdavOwncloud: detected overridden config - adding "{8whEN}" suffix to name 2024/11/22 03:01:10 DEBUG : Setting url="http://127.0.0.1:38081/remote.php/webdav/" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_URL 2024/11/22 03:01:10 DEBUG : Setting vendor="owncloud" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_VENDOR 2024/11/22 03:01:10 DEBUG : Setting user="rclone" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_USER 2024/11/22 03:01:10 DEBUG : Setting pass="W80x0N3RMbhwoih54FcJHfcU-MKOeMhquCpsYwJRhIOwES0" for "TestWebdavOwncloud" from environment variable RCLONE_CONFIG_TESTWEBDAVOWNCLOUD_PASS 2024/11/22 03:01:10 DEBUG : found headers: 2024/11/22 03:01:10 DEBUG : Creating backend with remote "/tmp/rclone2137203682" === RUN TestRmdirsNoLeaveRoot run.go:180: Remote "webdav root 'rclone-test-kufeyut7tejo'", Local "Local file system at /tmp/rclone2137203682", Modify Window "1s" 2024/11/22 03:01:11 DEBUG : A1/B1/C1/one: Update will use the normal upload strategy (no chunks) 2024/11/22 03:01:12 DEBUG : A2: Making directory 2024/11/22 03:01:12 DEBUG : A1/B2: Making directory 2024/11/22 03:01:12 DEBUG : A1/B2/C2: Making directory 2024/11/22 03:01:12 DEBUG : A1/B1/C3: Making directory 2024/11/22 03:01:12 DEBUG : A3: Making directory 2024/11/22 03:01:12 DEBUG : A3/B3: Making directory 2024/11/22 03:01:12 DEBUG : A3/B3/C4: Making directory 2024/11/22 03:01:12 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2024/11/22 03:01:13 DEBUG : removing 1 level 3 directories 2024/11/22 03:01:13 INFO : A3/B3/C4: Removing directory 2024/11/22 03:01:14 DEBUG : removing 2 level 3 directories 2024/11/22 03:01:14 INFO : A1/B2/C2: Removing directory 2024/11/22 03:01:14 INFO : A1/B1/C3: Removing directory 2024/11/22 03:01:14 DEBUG : pacer: low level retry 1/10 (error An exception occurred while executing 'UPDATE "oc_file_locks" SET "lock" = 0 WHERE "key" = ? AND "lock" = -1' with params ["files\/906b335b0715a47dc21afb1f263eebe1"]: SQLSTATE[HY000]: General error: 5 database is locked: Doctrine\DBAL\Exception\LockWaitTimeoutException: 500 Internal Server Error) 2024/11/22 03:01:14 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/22 03:01:14 DEBUG : pacer: Reducing sleep to 15ms 2024/11/22 03:01:14 DEBUG : pacer: Reducing sleep to 11.25ms 2024/11/22 03:01:14 ERROR : A1/B2/C2: Failed to rmdir: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden 2024/11/22 03:01:14 DEBUG : removing 2 level 2 directories 2024/11/22 03:01:14 INFO : A3/B3: Removing directory 2024/11/22 03:01:14 INFO : A1/B2: Removing directory 2024/11/22 03:01:14 DEBUG : pacer: Reducing sleep to 10ms 2024/11/22 03:01:14 DEBUG : pacer: low level retry 1/10 (error An exception occurred while executing 'UPDATE "oc_file_locks" SET "lock" = 0 WHERE "key" = ? AND "lock" = -1' with params ["files\/57ed38142f38c4f66b9d267478d34794"]: SQLSTATE[HY000]: General error: 5 database is locked: Doctrine\DBAL\Exception\LockWaitTimeoutException: 500 Internal Server Error) 2024/11/22 03:01:14 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/22 03:01:14 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:14 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/22 03:01:15 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:15 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/22 03:01:15 DEBUG : pacer: Reducing sleep to 60ms 2024/11/22 03:01:15 ERROR : A3/B3: Failed to rmdir: rmdir failed: Sabre\DAV\Exception\Forbidden: 403 Forbidden 2024/11/22 03:01:15 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:15 DEBUG : pacer: Rate limited, increasing sleep to 120ms 2024/11/22 03:01:15 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:15 DEBUG : pacer: Rate limited, increasing sleep to 240ms 2024/11/22 03:01:15 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:15 DEBUG : pacer: Rate limited, increasing sleep to 480ms 2024/11/22 03:01:15 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:15 DEBUG : pacer: Rate limited, increasing sleep to 960ms 2024/11/22 03:01:16 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:16 DEBUG : pacer: Rate limited, increasing sleep to 1.92s 2024/11/22 03:01:17 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:17 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:01:19 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:21 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:21 ERROR : A1/B2: Failed to rmdir: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:01:21 DEBUG : removing 2 level 1 directories 2024/11/22 03:01:21 INFO : A3: Removing directory 2024/11/22 03:01:21 INFO : A2: Removing directory 2024/11/22 03:01:23 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:01:25 DEBUG : pacer: Reducing sleep to 1.125s 2024/11/22 03:01:26 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:26 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:01:27 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:01:29 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:29 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:01:31 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:33 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:35 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:37 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:39 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:41 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:43 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:45 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:45 ERROR : A3: Failed to rmdir: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked operations_test.go:705: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 Error: Received unexpected error: failed to remove directories: 4 errors: last error: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked Test: TestRmdirsNoLeaveRoot 2024/11/22 03:01:47 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:01:49 DEBUG : pacer: Reducing sleep to 1.125s 2024/11/22 03:01:50 DEBUG : pacer: Reducing sleep to 843.75ms 2024/11/22 03:01:51 DEBUG : pacer: Reducing sleep to 632.8125ms 2024/11/22 03:01:52 DEBUG : pacer: Reducing sleep to 474.609375ms 2024/11/22 03:01:53 DEBUG : pacer: Reducing sleep to 355.957031ms 2024/11/22 03:01:53 DEBUG : pacer: Reducing sleep to 266.967773ms 2024/11/22 03:01:54 DEBUG : pacer: Reducing sleep to 200.225829ms 2024/11/22 03:01:54 DEBUG : pacer: Reducing sleep to 150.169371ms 2024/11/22 03:01:54 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:54 DEBUG : pacer: Rate limited, increasing sleep to 300.338742ms 2024/11/22 03:01:54 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:54 DEBUG : pacer: Rate limited, increasing sleep to 600.677484ms 2024/11/22 03:01:54 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:54 DEBUG : pacer: Rate limited, increasing sleep to 1.201354968s 2024/11/22 03:01:55 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:55 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:01:56 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:01:58 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:00 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:02 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:04 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:06 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A3" failed - try 1/3: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:02:08 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:02:10 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:10 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:02:12 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:14 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:16 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:18 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:20 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:22 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:24 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:26 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:28 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A3" failed - try 2/3: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:02:30 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:02:32 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:32 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:02:33 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:35 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:37 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:39 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:41 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:43 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:45 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:47 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:49 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A3" failed - try 3/3: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:128: removing dir "A3" failed: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:02:51 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:02:53 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:53 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:02:55 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:57 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:02:59 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:01 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:03 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:05 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:07 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:09 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:11 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A1/B2" failed - try 1/3: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:03:13 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:03:15 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:15 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:03:16 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:18 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:20 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:22 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:24 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:26 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:28 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:30 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:32 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A1/B2" failed - try 2/3: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:03:34 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:03:36 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:36 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:03:38 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:40 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:42 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:44 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:46 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:48 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:50 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:52 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:03:54 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A1/B2" failed - try 3/3: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:128: removing dir "A1/B2" failed: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:03:56 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:03:58 DEBUG : pacer: Reducing sleep to 1.125s 2024/11/22 03:03:59 DEBUG : pacer: Reducing sleep to 843.75ms 2024/11/22 03:04:01 DEBUG : pacer: Reducing sleep to 632.8125ms 2024/11/22 03:04:01 DEBUG : pacer: Reducing sleep to 474.609375ms run.go:125: removing dir "A1" failed - try 1/3: directory not empty 2024/11/22 03:04:02 DEBUG : pacer: Reducing sleep to 355.957031ms run.go:125: removing dir "A1" failed - try 2/3: directory not empty 2024/11/22 03:04:03 DEBUG : pacer: Reducing sleep to 266.967773ms run.go:125: removing dir "A1" failed - try 3/3: directory not empty run.go:128: removing dir "A1" failed: directory not empty 2024/11/22 03:04:05 DEBUG : pacer: Reducing sleep to 200.225829ms 2024/11/22 03:04:05 DEBUG : pacer: Reducing sleep to 150.169371ms 2024/11/22 03:04:05 DEBUG : pacer: Reducing sleep to 112.627028ms 2024/11/22 03:04:05 DEBUG : pacer: Reducing sleep to 84.470271ms fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/11/22 03:04:06 DEBUG : pacer: Reducing sleep to 63.352703ms 2024/11/22 03:04:06 DEBUG : pacer: Reducing sleep to 47.514527ms 2024/11/22 03:04:06 DEBUG : pacer: Reducing sleep to 35.635895ms 2024/11/22 03:04:07 DEBUG : pacer: Reducing sleep to 26.726921ms fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 2024/11/22 03:04:09 DEBUG : pacer: Reducing sleep to 20.04519ms 2024/11/22 03:04:09 DEBUG : pacer: Reducing sleep to 15.033892ms 2024/11/22 03:04:09 DEBUG : pacer: Reducing sleep to 11.275419ms 2024/11/22 03:04:09 DEBUG : pacer: Reducing sleep to 10ms fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:321 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1175 /usr/local/go/src/testing/testing.go:1353 /usr/local/go/src/testing/testing.go:1683 /usr/local/go/src/runtime/panic.go:626 /usr/local/go/src/testing/testing.go:1005 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:705 Error: Not equal: expected: []string{} actual : []string{"A1", "A1/B2", "A3"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) (len=2) "A1", + (string) (len=5) "A1/B2", + (string) (len=2) "A3" } Test: TestRmdirsNoLeaveRoot Messages: directories --- FAIL: TestRmdirsNoLeaveRoot (182.32s) === RUN TestDirMove run.go:180: Remote "webdav root 'rclone-test-kufeyut7tejo'", Local "Local file system at /tmp/rclone2137203682", Modify Window "1s" 2024/11/22 03:04:13 DEBUG : A1/one: Update will use the normal upload strategy (no chunks) 2024/11/22 03:04:13 DEBUG : A1/two: Update will use the normal upload strategy (no chunks) 2024/11/22 03:04:14 DEBUG : A1/B1/three: Update will use the normal upload strategy (no chunks) 2024/11/22 03:04:14 DEBUG : A1/B1/C1/four: Update will use the normal upload strategy (no chunks) 2024/11/22 03:04:14 DEBUG : A1/B1/C2/five: Update will use the normal upload strategy (no chunks) 2024/11/22 03:04:15 DEBUG : A1/B2: Making directory 2024/11/22 03:04:15 DEBUG : A1/B1/C3: Making directory fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:321 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1365 Error: Not equal: expected: []string{"A1", "A1/B1", "A1/B1/C1", "A1/B1/C2", "A1/B1/C3", "A1/B2"} actual : []string{"A1", "A1/B1", "A1/B1/C1", "A1/B1/C2", "A1/B1/C3", "A1/B2", "A3"} Diff: --- Expected +++ Actual @@ -1,2 +1,2 @@ -([]string) (len=6) { +([]string) (len=7) { (string) (len=2) "A1", @@ -6,3 +6,4 @@ (string) (len=8) "A1/B1/C3", - (string) (len=5) "A1/B2" + (string) (len=5) "A1/B2", + (string) (len=2) "A3" } Test: TestDirMove Messages: directories 2024/11/22 03:04:23 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:23 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/22 03:04:23 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:23 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/22 03:04:23 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:23 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/22 03:04:23 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:23 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/11/22 03:04:23 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:23 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/11/22 03:04:24 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:24 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/11/22 03:04:24 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:24 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/11/22 03:04:25 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:25 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:04:26 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) 2024/11/22 03:04:28 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error) operations_test.go:1380: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1380 Error: Received unexpected error: DirMove MOVE call failed: "rclone-test-kufeyut7tejo/A1" is locked: OCP\Lock\LockedException: 500 Internal Server Error Test: TestDirMove 2024/11/22 03:04:30 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:04:32 DEBUG : pacer: Reducing sleep to 1.125s 2024/11/22 03:04:33 DEBUG : pacer: Reducing sleep to 843.75ms 2024/11/22 03:04:34 DEBUG : pacer: Reducing sleep to 632.8125ms 2024/11/22 03:04:35 DEBUG : pacer: Reducing sleep to 474.609375ms 2024/11/22 03:04:36 DEBUG : pacer: Reducing sleep to 355.957031ms 2024/11/22 03:04:36 DEBUG : pacer: Reducing sleep to 266.967773ms 2024/11/22 03:04:37 DEBUG : pacer: Reducing sleep to 200.225829ms 2024/11/22 03:04:37 DEBUG : pacer: Reducing sleep to 150.169371ms 2024/11/22 03:04:37 DEBUG : pacer: Reducing sleep to 112.627028ms 2024/11/22 03:04:37 DEBUG : pacer: Reducing sleep to 84.470271ms 2024/11/22 03:04:38 DEBUG : pacer: Reducing sleep to 63.352703ms 2024/11/22 03:04:38 DEBUG : pacer: Reducing sleep to 47.514527ms 2024/11/22 03:04:38 DEBUG : pacer: Reducing sleep to 35.635895ms 2024/11/22 03:04:38 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:38 DEBUG : pacer: Rate limited, increasing sleep to 71.27179ms 2024/11/22 03:04:38 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:38 DEBUG : pacer: Rate limited, increasing sleep to 142.54358ms 2024/11/22 03:04:38 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:38 DEBUG : pacer: Rate limited, increasing sleep to 285.08716ms 2024/11/22 03:04:38 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:38 DEBUG : pacer: Rate limited, increasing sleep to 570.17432ms 2024/11/22 03:04:38 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:38 DEBUG : pacer: Rate limited, increasing sleep to 1.14034864s 2024/11/22 03:04:39 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:39 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:04:40 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:42 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:44 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:46 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A3" failed - try 1/3: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:04:48 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:04:50 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:50 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:04:52 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:54 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:56 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:04:58 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:00 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:02 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:04 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:06 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:08 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A3" failed - try 2/3: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:05:10 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:05:12 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:12 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:05:13 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:15 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:17 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:19 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:21 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:23 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:25 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:27 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:29 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A3" failed - try 3/3: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:128: removing dir "A3" failed: rmdir failed: "rclone-test-kufeyut7tejo/A3" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:05:31 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:05:33 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:33 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:05:35 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:37 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:39 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:41 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:43 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:45 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:47 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:49 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:51 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A1/B2" failed - try 1/3: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:05:53 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:05:55 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:55 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:05:56 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:05:58 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:00 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:02 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:04 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:06 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:08 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:10 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:12 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A1/B2" failed - try 2/3: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:06:14 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:06:16 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:16 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:06:18 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:20 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:22 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:24 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:26 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:28 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:30 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:32 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:34 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) run.go:125: removing dir "A1/B2" failed - try 3/3: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked run.go:128: removing dir "A1/B2" failed: rmdir failed: "rclone-test-kufeyut7tejo/A1/B2" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked 2024/11/22 03:06:36 DEBUG : pacer: Reducing sleep to 1.5s 2024/11/22 03:06:38 DEBUG : pacer: Reducing sleep to 1.125s 2024/11/22 03:06:39 DEBUG : pacer: Reducing sleep to 843.75ms 2024/11/22 03:06:40 DEBUG : pacer: Reducing sleep to 632.8125ms 2024/11/22 03:06:41 DEBUG : pacer: Reducing sleep to 474.609375ms 2024/11/22 03:06:42 DEBUG : pacer: Reducing sleep to 355.957031ms 2024/11/22 03:06:42 DEBUG : pacer: Reducing sleep to 266.967773ms 2024/11/22 03:06:43 DEBUG : pacer: Reducing sleep to 200.225829ms 2024/11/22 03:06:43 DEBUG : pacer: Reducing sleep to 150.169371ms run.go:125: removing dir "A1" failed - try 1/3: directory not empty 2024/11/22 03:06:44 DEBUG : pacer: Reducing sleep to 112.627028ms run.go:125: removing dir "A1" failed - try 2/3: directory not empty 2024/11/22 03:06:45 DEBUG : pacer: Reducing sleep to 84.470271ms run.go:125: removing dir "A1" failed - try 3/3: directory not empty run.go:128: removing dir "A1" failed: directory not empty 2024/11/22 03:06:46 DEBUG : pacer: Reducing sleep to 63.352703ms 2024/11/22 03:06:46 DEBUG : pacer: Reducing sleep to 47.514527ms 2024/11/22 03:06:46 DEBUG : pacer: Reducing sleep to 35.635895ms 2024/11/22 03:06:46 DEBUG : pacer: Reducing sleep to 26.726921ms fstest.go:292: Sleeping for 1s for list eventual consistency: 1/3 2024/11/22 03:06:48 DEBUG : pacer: Reducing sleep to 20.04519ms 2024/11/22 03:06:48 DEBUG : pacer: Reducing sleep to 15.033892ms 2024/11/22 03:06:48 DEBUG : pacer: Reducing sleep to 11.275419ms 2024/11/22 03:06:48 DEBUG : pacer: Reducing sleep to 10ms fstest.go:292: Sleeping for 2s for list eventual consistency: 2/3 fstest.go:292: Sleeping for 4s for list eventual consistency: 3/3 fstest.go:321: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:321 /home/rclone/go/src/github.com/rclone/rclone/fstest/fstest.go:332 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:173 /home/rclone/go/src/github.com/rclone/rclone/fstest/run.go:388 /usr/local/go/src/testing/testing.go:1175 /usr/local/go/src/testing/testing.go:1353 /usr/local/go/src/testing/testing.go:1683 /usr/local/go/src/runtime/panic.go:626 /usr/local/go/src/testing/testing.go:1005 /home/rclone/go/src/github.com/rclone/rclone/fs/operations/operations_test.go:1380 Error: Not equal: expected: []string{} actual : []string{"A1", "A1/B2", "A3"} Diff: --- Expected +++ Actual @@ -1,2 +1,5 @@ -([]string) { +([]string) (len=3) { + (string) (len=2) "A1", + (string) (len=5) "A1/B2", + (string) (len=2) "A3" } Test: TestDirMove Messages: directories --- FAIL: TestDirMove (161.15s) FAIL 2024/11/22 03:06:54 DEBUG : webdav root 'rclone-test-kufeyut7tejo': Purge remote 2024/11/22 03:06:54 DEBUG : pacer: low level retry 1/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:54 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2024/11/22 03:06:54 DEBUG : pacer: low level retry 2/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:54 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2024/11/22 03:06:54 DEBUG : pacer: low level retry 3/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:54 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2024/11/22 03:06:54 DEBUG : pacer: low level retry 4/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:54 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2024/11/22 03:06:54 DEBUG : pacer: low level retry 5/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:54 DEBUG : pacer: Rate limited, increasing sleep to 320ms 2024/11/22 03:06:55 DEBUG : pacer: low level retry 6/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:55 DEBUG : pacer: Rate limited, increasing sleep to 640ms 2024/11/22 03:06:55 DEBUG : pacer: low level retry 7/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:55 DEBUG : pacer: Rate limited, increasing sleep to 1.28s 2024/11/22 03:06:55 DEBUG : pacer: low level retry 8/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:55 DEBUG : pacer: Rate limited, increasing sleep to 2s 2024/11/22 03:06:57 DEBUG : pacer: low level retry 9/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:59 DEBUG : pacer: low level retry 10/10 (error "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked) 2024/11/22 03:06:59 NOTICE: purge failed: rmdir failed: "rclone-test-kufeyut7tejo" is locked: OCA\DAV\Connector\Sabre\Exception\FileLocked: 423 Locked "./operations.test -test.v -test.timeout 1h0m0s -remote TestWebdavOwncloud: -verbose -test.run '^(TestDirMove|TestRmdirsNoLeaveRoot)$'" - Finished ERROR in 5m49.070836315s (try 5/5): exit status 1: Failed [TestRmdirsNoLeaveRoot TestDirMove]