"./sync.test -test.v -test.timeout 1h0m0s -remote TestDropbox: -verbose -test.run '^TestFixCase$'" - Starting (try 3/5) 2025/02/16 04:00:01 DEBUG : Creating backend with remote "TestDropbox:rclone-test-bafidah9nere" 2025/02/16 04:00:01 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/02/16 04:00:01 DEBUG : Creating backend with remote "/tmp/rclone3652087548" === RUN TestFixCase run.go:180: Remote "Dropbox root 'rclone-test-bafidah9nere'", Local "Local file system at /tmp/rclone3652087548", Modify Window "1s" 2025/02/16 04:00:02 DEBUG : EXISTING: Uploading chunk 1/1 2025/02/16 04:00:02 DEBUG : EXISTING: Uploading chunk 2/1 2025/02/16 04:00:03 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "EXISTING" to batch 2025/02/16 04:00:03 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:03 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: EXISTING 2025/02/16 04:00:04 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committed sync batch length 1 starting with: EXISTING 2025/02/16 04:00:04 DEBUG : EXISTINGBUTDIFFERENT: Uploading chunk 1/1 2025/02/16 04:00:05 DEBUG : EXISTINGBUTDIFFERENT: Uploading chunk 2/1 2025/02/16 04:00:05 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "EXISTINGBUTDIFFERENT" to batch 2025/02/16 04:00:06 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:06 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: EXISTINGBUTDIFFERENT 2025/02/16 04:00:06 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committed sync batch length 1 starting with: EXISTINGBUTDIFFERENT 2025/02/16 04:00:07 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: Uploading chunk 1/1 2025/02/16 04:00:07 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: Uploading chunk 2/1 2025/02/16 04:00:08 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "SUBDIRA/subdirb/SUBDIRC/HELLO" to batch 2025/02/16 04:00:08 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:08 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/HELLO 2025/02/16 04:00:10 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committed sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/HELLO 2025/02/16 04:00:10 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Uploading chunk 1/1 2025/02/16 04:00:10 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Uploading chunk 2/1 2025/02/16 04:00:11 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences" to batch 2025/02/16 04:00:11 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:11 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences 2025/02/16 04:00:12 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committed sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences 2025/02/16 04:00:14 DEBUG : existing: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2025/02/16 04:00:14 DEBUG : existing: Unchanged skipping 2025/02/16 04:00:14 DEBUG : existingbutdifferent: Sizes differ (src 5 vs dst 8) 2025/02/16 04:00:14 DEBUG : EXISTING: moving to existing-rclone-move-yexajak3 2025/02/16 04:00:14 DEBUG : EXISTINGBUTDIFFERENT: moving to existingbutdifferent-rclone-move-basapiv4 2025/02/16 04:00:14 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/02/16 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/02/16 04:00:14 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/..) 2025/02/16 04:00:14 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/02/16 04:00:15 DEBUG : pacer: Reducing sleep to 30ms 2025/02/16 04:00:16 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/02/16 04:00:16 DEBUG : pacer: Rate limited, increasing sleep to 60ms 2025/02/16 04:00:16 DEBUG : pacer: Reducing sleep to 45ms 2025/02/16 04:00:16 INFO : EXISTING: Moved (server-side) to: existing-rclone-move-yexajak3 2025/02/16 04:00:16 DEBUG : EXISTING: moving to existing 2025/02/16 04:00:16 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/..) 2025/02/16 04:00:16 DEBUG : pacer: Rate limited, increasing sleep to 90ms 2025/02/16 04:00:16 DEBUG : pacer: low level retry 3/10 (error too_many_write_operations/.) 2025/02/16 04:00:16 DEBUG : pacer: Rate limited, increasing sleep to 180ms 2025/02/16 04:00:16 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/02/16 04:00:16 DEBUG : pacer: Rate limited, increasing sleep to 360ms 2025/02/16 04:00:17 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/..) 2025/02/16 04:00:17 DEBUG : pacer: Rate limited, increasing sleep to 720ms 2025/02/16 04:00:17 DEBUG : pacer: Reducing sleep to 540ms 2025/02/16 04:00:18 DEBUG : pacer: low level retry 4/10 (error too_many_write_operations/...) 2025/02/16 04:00:18 DEBUG : pacer: Rate limited, increasing sleep to 1.08s 2025/02/16 04:00:18 DEBUG : pacer: Reducing sleep to 810ms 2025/02/16 04:00:18 DEBUG : pacer: Reducing sleep to 607.5ms 2025/02/16 04:00:18 INFO : existing-rclone-move-yexajak3: Moved (server-side) to: existing 2025/02/16 04:00:18 INFO : EXISTING: Moved (server-side) to: existing 2025/02/16 04:00:18 INFO : EXISTING: Fixed case by renaming to: existing 2025/02/16 04:00:19 DEBUG : pacer: low level retry 5/10 (error too_many_write_operations/...) 2025/02/16 04:00:19 DEBUG : pacer: Rate limited, increasing sleep to 1.215s 2025/02/16 04:00:20 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/02/16 04:00:20 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/02/16 04:00:21 DEBUG : pacer: Reducing sleep to 1.5s 2025/02/16 04:00:21 INFO : EXISTINGBUTDIFFERENT: Moved (server-side) to: existingbutdifferent-rclone-move-basapiv4 2025/02/16 04:00:21 DEBUG : EXISTINGBUTDIFFERENT: moving to existingbutdifferent 2025/02/16 04:00:22 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/.) 2025/02/16 04:00:22 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/02/16 04:00:25 DEBUG : pacer: Reducing sleep to 1.5s 2025/02/16 04:00:25 INFO : existingbutdifferent-rclone-move-basapiv4: Moved (server-side) to: existingbutdifferent 2025/02/16 04:00:25 INFO : EXISTINGBUTDIFFERENT: Moved (server-side) to: existingbutdifferent 2025/02/16 04:00:25 INFO : EXISTINGBUTDIFFERENT: Fixed case by renaming to: existingbutdifferent 2025/02/16 04:00:27 DEBUG : pacer: Reducing sleep to 1.125s 2025/02/16 04:00:27 INFO : SUBDIRA: Fixed case by renaming to: subdira 2025/02/16 04:00:27 DEBUG : pacer: Reducing sleep to 843.75ms 2025/02/16 04:00:27 DEBUG : existingbutdifferent: Uploading chunk 1/1 2025/02/16 04:00:28 DEBUG : pacer: Reducing sleep to 632.8125ms 2025/02/16 04:00:29 DEBUG : pacer: Reducing sleep to 474.609375ms 2025/02/16 04:00:29 DEBUG : existingbutdifferent: Uploading chunk 2/1 2025/02/16 04:00:30 DEBUG : pacer: Reducing sleep to 355.957031ms 2025/02/16 04:00:31 DEBUG : pacer: Reducing sleep to 266.967773ms 2025/02/16 04:00:31 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "existingbutdifferent" to batch 2025/02/16 04:00:31 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:31 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: existingbutdifferent 2025/02/16 04:00:32 DEBUG : pacer: Reducing sleep to 200.225829ms 2025/02/16 04:00:32 DEBUG : pacer: Reducing sleep to 150.169371ms 2025/02/16 04:00:33 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/02/16 04:00:33 DEBUG : pacer: Rate limited, increasing sleep to 300.338742ms 2025/02/16 04:00:34 DEBUG : pacer: Reducing sleep to 225.254056ms 2025/02/16 04:00:34 ERROR : Dropbox root 'rclone-test-bafidah9nere': sync batch commit: failed to commit batch length 1: batch had 1 errors: last error: upload failed: too_many_write_operations 2025/02/16 04:00:34 ERROR : existingbutdifferent: Failed to copy: upload failed: batch upload failed: upload failed: too_many_write_operations 2025/02/16 04:00:34 DEBUG : pacer: Reducing sleep to 168.940542ms 2025/02/16 04:00:34 INFO : SUBDIRA/subdirb: Fixed case by renaming to: subdira/subdirb 2025/02/16 04:00:35 DEBUG : pacer: Reducing sleep to 126.705406ms 2025/02/16 04:00:35 DEBUG : pacer: Reducing sleep to 95.029054ms 2025/02/16 04:00:36 DEBUG : pacer: Reducing sleep to 71.27179ms 2025/02/16 04:00:36 DEBUG : pacer: Reducing sleep to 53.453842ms 2025/02/16 04:00:37 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/...) 2025/02/16 04:00:37 DEBUG : pacer: Rate limited, increasing sleep to 106.907684ms 2025/02/16 04:00:37 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/..) 2025/02/16 04:00:37 DEBUG : pacer: Rate limited, increasing sleep to 213.815368ms 2025/02/16 04:00:39 DEBUG : pacer: Reducing sleep to 160.361526ms 2025/02/16 04:00:39 INFO : SUBDIRA/subdirb/SUBDIRC: Fixed case by renaming to: subdira/subdirb/subdirc 2025/02/16 04:00:39 DEBUG : pacer: Reducing sleep to 120.271144ms 2025/02/16 04:00:39 DEBUG : subdira/subdirb/subdirc/hello: Sizes differ (src 5 vs dst 8) 2025/02/16 04:00:39 DEBUG : pacer: Reducing sleep to 90.203358ms 2025/02/16 04:00:39 DEBUG : pacer: Reducing sleep to 67.652518ms 2025/02/16 04:00:39 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: moving to subdira/subdirb/subdirc/hello-rclone-move-wewulik3 2025/02/16 04:00:40 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/02/16 04:00:40 DEBUG : pacer: Rate limited, increasing sleep to 135.305036ms 2025/02/16 04:00:40 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/..) 2025/02/16 04:00:40 DEBUG : pacer: Rate limited, increasing sleep to 270.610072ms 2025/02/16 04:00:41 DEBUG : pacer: Reducing sleep to 202.957554ms 2025/02/16 04:00:41 DEBUG : pacer: Reducing sleep to 152.218165ms 2025/02/16 04:00:42 DEBUG : pacer: low level retry 3/10 (error too_many_write_operations/.) 2025/02/16 04:00:42 DEBUG : pacer: Rate limited, increasing sleep to 304.43633ms 2025/02/16 04:00:42 DEBUG : pacer: low level retry 4/10 (error too_many_write_operations/.) 2025/02/16 04:00:42 DEBUG : pacer: Rate limited, increasing sleep to 608.87266ms 2025/02/16 04:00:42 DEBUG : pacer: Reducing sleep to 456.654495ms 2025/02/16 04:00:42 INFO : SUBDIRA/subdirb/SUBDIRC/subdird: Fixed case by renaming to: subdira/subdirb/subdirc/subdird 2025/02/16 04:00:43 DEBUG : pacer: Reducing sleep to 342.490871ms 2025/02/16 04:00:43 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Sizes differ (src 5 vs dst 8) 2025/02/16 04:00:43 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Waiting for checks to finish 2025/02/16 04:00:43 DEBUG : pacer: Reducing sleep to 256.868153ms 2025/02/16 04:00:43 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: moving to subdira/subdirb/subdirc/subdird/filewithoutcasedifferences-rclone-move-cejuzak3 2025/02/16 04:00:44 DEBUG : pacer: Reducing sleep to 192.651114ms 2025/02/16 04:00:44 INFO : SUBDIRA/subdirb/SUBDIRC/HELLO: Moved (server-side) to: subdira/subdirb/subdirc/hello-rclone-move-wewulik3 2025/02/16 04:00:44 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: moving to subdira/subdirb/subdirc/hello 2025/02/16 04:00:44 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/02/16 04:00:44 DEBUG : pacer: Rate limited, increasing sleep to 385.302228ms 2025/02/16 04:00:45 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/..) 2025/02/16 04:00:45 DEBUG : pacer: Rate limited, increasing sleep to 770.604456ms 2025/02/16 04:00:45 DEBUG : pacer: Reducing sleep to 577.953342ms 2025/02/16 04:00:45 INFO : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Moved (server-side) to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences-rclone-move-cejuzak3 2025/02/16 04:00:45 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: moving to subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/02/16 04:00:46 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/02/16 04:00:46 DEBUG : pacer: Rate limited, increasing sleep to 1.155906684s 2025/02/16 04:00:46 DEBUG : pacer: Reducing sleep to 866.930013ms 2025/02/16 04:00:46 INFO : subdira/subdirb/subdirc/hello-rclone-move-wewulik3: Moved (server-side) to: subdira/subdirb/subdirc/hello 2025/02/16 04:00:46 INFO : SUBDIRA/subdirb/SUBDIRC/HELLO: Moved (server-side) to: subdira/subdirb/subdirc/hello 2025/02/16 04:00:46 INFO : SUBDIRA/subdirb/SUBDIRC/HELLO: Fixed case by renaming to: subdira/subdirb/subdirc/hello 2025/02/16 04:00:47 DEBUG : pacer: Reducing sleep to 650.197509ms 2025/02/16 04:00:47 DEBUG : subdira/subdirb/subdirc/hello: Uploading chunk 1/1 2025/02/16 04:00:48 DEBUG : pacer: Reducing sleep to 487.648131ms 2025/02/16 04:00:48 INFO : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences-rclone-move-cejuzak3: Moved (server-side) to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/02/16 04:00:48 INFO : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Moved (server-side) to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/02/16 04:00:48 INFO : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Fixed case by renaming to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/02/16 04:00:48 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Waiting for transfers to finish 2025/02/16 04:00:48 DEBUG : pacer: Reducing sleep to 365.736098ms 2025/02/16 04:00:48 DEBUG : subdira/subdirb/subdirc/hello: Uploading chunk 2/1 2025/02/16 04:00:49 DEBUG : pacer: Reducing sleep to 274.302073ms 2025/02/16 04:00:49 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Uploading chunk 1/1 2025/02/16 04:00:49 DEBUG : pacer: Reducing sleep to 205.726554ms 2025/02/16 04:00:49 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "subdira/subdirb/subdirc/hello" to batch 2025/02/16 04:00:50 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:50 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: subdira/subdirb/subdirc/hello 2025/02/16 04:00:50 DEBUG : pacer: Reducing sleep to 154.294915ms 2025/02/16 04:00:50 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Uploading chunk 2/1 2025/02/16 04:00:50 DEBUG : pacer: Reducing sleep to 115.721186ms 2025/02/16 04:00:50 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Adding "subdira/subdirb/subdirc/subdird/filewithoutcasedifferences" to batch 2025/02/16 04:00:51 DEBUG : pacer: Reducing sleep to 86.790889ms 2025/02/16 04:00:51 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committed sync batch length 1 starting with: subdira/subdirb/subdirc/hello 2025/02/16 04:00:51 DEBUG : subdira/subdirb/subdirc/hello: dropbox = 876764f8f7cb4581b40dd4a7a1be217b2c58ae386ca01c86ea0b30bba6d050ed OK 2025/02/16 04:00:51 INFO : subdira/subdirb/subdirc/hello: Copied (replaced existing) 2025/02/16 04:00:51 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Batch idle for 500ms so committing 2025/02/16 04:00:51 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committing sync batch length 1 starting with: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/02/16 04:00:53 DEBUG : pacer: Reducing sleep to 65.093166ms 2025/02/16 04:00:53 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Committed sync batch length 1 starting with: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/02/16 04:00:53 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: dropbox = 876764f8f7cb4581b40dd4a7a1be217b2c58ae386ca01c86ea0b30bba6d050ed OK 2025/02/16 04:00:53 INFO : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Copied (replaced existing) 2025/02/16 04:00:53 ERROR : Dropbox root 'rclone-test-bafidah9nere': not deleting files as there were IO errors 2025/02/16 04:00:53 ERROR : Dropbox root 'rclone-test-bafidah9nere': not deleting directories as there were IO errors sync_test.go:2655: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2655 Error: Received unexpected error: upload failed: batch upload failed: upload failed: too_many_write_operations Test: TestFixCase 2025/02/16 04:00:53 DEBUG : pacer: Reducing sleep to 48.819874ms 2025/02/16 04:00:54 DEBUG : pacer: Reducing sleep to 36.614905ms 2025/02/16 04:00:55 DEBUG : pacer: Reducing sleep to 27.461178ms 2025/02/16 04:00:55 DEBUG : pacer: Reducing sleep to 20.595883ms 2025/02/16 04:00:55 DEBUG : pacer: Reducing sleep to 15.446912ms 2025/02/16 04:00:56 DEBUG : pacer: Reducing sleep to 11.585184ms 2025/02/16 04:00:56 DEBUG : pacer: Reducing sleep to 10ms --- FAIL: TestFixCase (61.52s) FAIL 2025/02/16 04:01:02 DEBUG : Dropbox root 'rclone-test-bafidah9nere': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestDropbox: -verbose -test.run '^TestFixCase$'" - Finished ERROR in 1m3.311872827s (try 3/5): exit status 1: Failed [TestFixCase]