"./sync.test -test.v -test.timeout 1h0m0s -remote TestDropbox: -verbose -test.run '^TestFixCase$'" - Starting (try 2/5) 2025/05/01 02:07:25 DEBUG : Creating backend with remote "TestDropbox:rclone-test-pacojuw2hubu" 2025/05/01 02:07:25 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2025/05/01 02:07:25 DEBUG : Creating backend with remote "/tmp/rclone2670092559" === RUN TestFixCase run.go:180: Remote "Dropbox root 'rclone-test-pacojuw2hubu'", Local "Local file system at /tmp/rclone2670092559", Modify Window "1s" 2025/05/01 02:07:26 DEBUG : EXISTING: Uploading chunk 1/1 2025/05/01 02:07:27 DEBUG : EXISTING: Uploading chunk 2/1 2025/05/01 02:07:27 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "EXISTING" to batch 2025/05/01 02:07:28 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:07:28 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: EXISTING 2025/05/01 02:07:29 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committed sync batch length 1 starting with: EXISTING 2025/05/01 02:07:30 DEBUG : EXISTINGBUTDIFFERENT: Uploading chunk 1/1 2025/05/01 02:07:30 DEBUG : EXISTINGBUTDIFFERENT: Uploading chunk 2/1 2025/05/01 02:07:31 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "EXISTINGBUTDIFFERENT" to batch 2025/05/01 02:07:31 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:07:31 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: EXISTINGBUTDIFFERENT 2025/05/01 02:07:32 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committed sync batch length 1 starting with: EXISTINGBUTDIFFERENT 2025/05/01 02:07:32 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: Uploading chunk 1/1 2025/05/01 02:07:33 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: Uploading chunk 2/1 2025/05/01 02:07:34 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "SUBDIRA/subdirb/SUBDIRC/HELLO" to batch 2025/05/01 02:07:34 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:07:34 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/HELLO 2025/05/01 02:07:36 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committed sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/HELLO 2025/05/01 02:07:37 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Uploading chunk 1/1 2025/05/01 02:07:37 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Uploading chunk 2/1 2025/05/01 02:07:38 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences" to batch 2025/05/01 02:07:38 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:07:38 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences 2025/05/01 02:07:39 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committed sync batch length 1 starting with: SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences 2025/05/01 02:07:41 DEBUG : existing: Size and modification time the same (differ by -499.999999ms, within tolerance 1s) 2025/05/01 02:07:41 DEBUG : existing: Unchanged skipping 2025/05/01 02:07:41 DEBUG : existingbutdifferent: Sizes differ (src 5 vs dst 8) 2025/05/01 02:07:41 DEBUG : EXISTING: moving to existing-rclone-move-vuwevig3 2025/05/01 02:07:41 DEBUG : EXISTINGBUTDIFFERENT: moving to existingbutdifferent-rclone-move-vanexad6 2025/05/01 02:07:42 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/...) 2025/05/01 02:07:42 DEBUG : pacer: Rate limited, increasing sleep to 20ms 2025/05/01 02:07:42 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/...) 2025/05/01 02:07:42 DEBUG : pacer: Rate limited, increasing sleep to 40ms 2025/05/01 02:07:42 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/) 2025/05/01 02:07:42 DEBUG : pacer: Rate limited, increasing sleep to 80ms 2025/05/01 02:07:42 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/.) 2025/05/01 02:07:42 DEBUG : pacer: Rate limited, increasing sleep to 160ms 2025/05/01 02:07:42 DEBUG : pacer: Reducing sleep to 120ms 2025/05/01 02:07:42 INFO : EXISTINGBUTDIFFERENT: Moved (server-side) to: existingbutdifferent-rclone-move-vanexad6 2025/05/01 02:07:42 DEBUG : EXISTINGBUTDIFFERENT: moving to existingbutdifferent 2025/05/01 02:07:43 DEBUG : pacer: low level retry 3/10 (error too_many_write_operations/.) 2025/05/01 02:07:43 DEBUG : pacer: Rate limited, increasing sleep to 240ms 2025/05/01 02:07:43 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/05/01 02:07:43 DEBUG : pacer: Rate limited, increasing sleep to 480ms 2025/05/01 02:07:44 DEBUG : pacer: low level retry 4/10 (error too_many_write_operations/...) 2025/05/01 02:07:44 DEBUG : pacer: Rate limited, increasing sleep to 960ms 2025/05/01 02:07:44 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/...) 2025/05/01 02:07:44 DEBUG : pacer: Rate limited, increasing sleep to 1.92s 2025/05/01 02:07:44 DEBUG : pacer: Reducing sleep to 1.44s 2025/05/01 02:07:44 DEBUG : pacer: low level retry 5/10 (error too_many_write_operations/..) 2025/05/01 02:07:44 DEBUG : pacer: Rate limited, increasing sleep to 2s 2025/05/01 02:07:46 DEBUG : pacer: Reducing sleep to 1.5s 2025/05/01 02:07:46 INFO : existingbutdifferent-rclone-move-vanexad6: Moved (server-side) to: existingbutdifferent 2025/05/01 02:07:46 INFO : EXISTINGBUTDIFFERENT: Moved (server-side) to: existingbutdifferent 2025/05/01 02:07:46 INFO : EXISTINGBUTDIFFERENT: Fixed case by renaming to: existingbutdifferent 2025/05/01 02:07:47 DEBUG : pacer: Reducing sleep to 1.125s 2025/05/01 02:07:49 DEBUG : pacer: Reducing sleep to 843.75ms 2025/05/01 02:07:49 INFO : EXISTING: Moved (server-side) to: existing-rclone-move-vuwevig3 2025/05/01 02:07:49 DEBUG : EXISTING: moving to existing 2025/05/01 02:07:50 DEBUG : pacer: Reducing sleep to 632.8125ms 2025/05/01 02:07:50 DEBUG : existingbutdifferent: Uploading chunk 1/1 2025/05/01 02:07:52 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/05/01 02:07:52 DEBUG : pacer: Rate limited, increasing sleep to 1.265625s 2025/05/01 02:07:52 DEBUG : pacer: Reducing sleep to 949.21875ms 2025/05/01 02:07:52 INFO : SUBDIRA: Fixed case by renaming to: subdira 2025/05/01 02:07:52 DEBUG : pacer: Reducing sleep to 711.914062ms 2025/05/01 02:07:52 DEBUG : existingbutdifferent: Uploading chunk 2/1 2025/05/01 02:07:54 DEBUG : pacer: Reducing sleep to 533.935546ms 2025/05/01 02:07:55 DEBUG : pacer: Reducing sleep to 400.451659ms 2025/05/01 02:07:55 INFO : existing-rclone-move-vuwevig3: Moved (server-side) to: existing 2025/05/01 02:07:55 INFO : EXISTING: Moved (server-side) to: existing 2025/05/01 02:07:55 INFO : EXISTING: Fixed case by renaming to: existing 2025/05/01 02:07:55 DEBUG : pacer: Reducing sleep to 300.338744ms 2025/05/01 02:07:55 DEBUG : pacer: Reducing sleep to 225.254058ms 2025/05/01 02:07:55 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "existingbutdifferent" to batch 2025/05/01 02:07:56 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:07:56 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: existingbutdifferent 2025/05/01 02:07:57 DEBUG : pacer: Reducing sleep to 168.940543ms 2025/05/01 02:07:57 DEBUG : pacer: Reducing sleep to 126.705407ms 2025/05/01 02:07:57 DEBUG : pacer: Reducing sleep to 95.029055ms 2025/05/01 02:07:57 ERROR : Dropbox root 'rclone-test-pacojuw2hubu': sync batch commit: failed to commit batch length 1: batch had 1 errors: last error: upload failed: too_many_write_operations 2025/05/01 02:07:57 ERROR : existingbutdifferent: Failed to copy: upload failed: batch upload failed: upload failed: too_many_write_operations 2025/05/01 02:07:58 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/05/01 02:07:58 DEBUG : pacer: Rate limited, increasing sleep to 190.05811ms 2025/05/01 02:07:59 DEBUG : pacer: Reducing sleep to 142.543582ms 2025/05/01 02:07:59 INFO : SUBDIRA/subdirb: Fixed case by renaming to: subdira/subdirb 2025/05/01 02:07:59 DEBUG : pacer: Reducing sleep to 106.907686ms 2025/05/01 02:08:00 DEBUG : pacer: Reducing sleep to 80.180764ms 2025/05/01 02:08:01 DEBUG : pacer: Reducing sleep to 60.135573ms 2025/05/01 02:08:01 DEBUG : pacer: Reducing sleep to 45.101679ms 2025/05/01 02:08:03 DEBUG : pacer: Reducing sleep to 33.826259ms 2025/05/01 02:08:03 INFO : SUBDIRA/subdirb/SUBDIRC: Fixed case by renaming to: subdira/subdirb/subdirc 2025/05/01 02:08:03 DEBUG : pacer: Reducing sleep to 25.369694ms 2025/05/01 02:08:03 DEBUG : subdira/subdirb/subdirc/hello: Sizes differ (src 5 vs dst 8) 2025/05/01 02:08:03 DEBUG : pacer: Reducing sleep to 19.02727ms 2025/05/01 02:08:03 DEBUG : pacer: Reducing sleep to 14.270452ms 2025/05/01 02:08:03 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: moving to subdira/subdirb/subdirc/hello-rclone-move-pecekiy9 2025/05/01 02:08:04 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/) 2025/05/01 02:08:04 DEBUG : pacer: Rate limited, increasing sleep to 28.540904ms 2025/05/01 02:08:05 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/.) 2025/05/01 02:08:05 DEBUG : pacer: Rate limited, increasing sleep to 57.081808ms 2025/05/01 02:08:05 DEBUG : pacer: Reducing sleep to 42.811356ms 2025/05/01 02:08:05 INFO : SUBDIRA/subdirb/SUBDIRC/HELLO: Moved (server-side) to: subdira/subdirb/subdirc/hello-rclone-move-pecekiy9 2025/05/01 02:08:05 DEBUG : SUBDIRA/subdirb/SUBDIRC/HELLO: moving to subdira/subdirb/subdirc/hello 2025/05/01 02:08:06 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/05/01 02:08:06 DEBUG : pacer: Rate limited, increasing sleep to 85.622712ms 2025/05/01 02:08:06 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/..) 2025/05/01 02:08:06 DEBUG : pacer: Rate limited, increasing sleep to 171.245424ms 2025/05/01 02:08:06 DEBUG : pacer: Reducing sleep to 128.434068ms 2025/05/01 02:08:07 DEBUG : pacer: Reducing sleep to 96.325551ms 2025/05/01 02:08:07 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/...) 2025/05/01 02:08:07 DEBUG : pacer: Rate limited, increasing sleep to 192.651102ms 2025/05/01 02:08:07 DEBUG : pacer: Reducing sleep to 144.488326ms 2025/05/01 02:08:07 INFO : subdira/subdirb/subdirc/hello-rclone-move-pecekiy9: Moved (server-side) to: subdira/subdirb/subdirc/hello 2025/05/01 02:08:07 INFO : SUBDIRA/subdirb/SUBDIRC/HELLO: Moved (server-side) to: subdira/subdirb/subdirc/hello 2025/05/01 02:08:07 INFO : SUBDIRA/subdirb/SUBDIRC/HELLO: Fixed case by renaming to: subdira/subdirb/subdirc/hello 2025/05/01 02:08:08 DEBUG : pacer: Reducing sleep to 108.366244ms 2025/05/01 02:08:08 DEBUG : subdira/subdirb/subdirc/hello: Uploading chunk 1/1 2025/05/01 02:08:08 DEBUG : pacer: Reducing sleep to 81.274683ms 2025/05/01 02:08:08 DEBUG : subdira/subdirb/subdirc/hello: Uploading chunk 2/1 2025/05/01 02:08:09 DEBUG : pacer: Reducing sleep to 60.956012ms 2025/05/01 02:08:09 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "subdira/subdirb/subdirc/hello" to batch 2025/05/01 02:08:09 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:08:09 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: subdira/subdirb/subdirc/hello 2025/05/01 02:08:09 DEBUG : pacer: Reducing sleep to 45.717009ms 2025/05/01 02:08:09 INFO : SUBDIRA/subdirb/SUBDIRC/subdird: Fixed case by renaming to: subdira/subdirb/subdirc/subdird 2025/05/01 02:08:10 DEBUG : pacer: Reducing sleep to 34.287756ms 2025/05/01 02:08:10 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Sizes differ (src 5 vs dst 8) 2025/05/01 02:08:10 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Waiting for checks to finish 2025/05/01 02:08:10 DEBUG : pacer: Reducing sleep to 25.715817ms 2025/05/01 02:08:10 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: moving to subdira/subdirb/subdirc/subdird/filewithoutcasedifferences-rclone-move-rasisil9 2025/05/01 02:08:10 DEBUG : pacer: Reducing sleep to 19.286862ms 2025/05/01 02:08:10 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committed sync batch length 1 starting with: subdira/subdirb/subdirc/hello 2025/05/01 02:08:10 DEBUG : subdira/subdirb/subdirc/hello: dropbox = 876764f8f7cb4581b40dd4a7a1be217b2c58ae386ca01c86ea0b30bba6d050ed OK 2025/05/01 02:08:10 INFO : subdira/subdirb/subdirc/hello: Copied (replaced existing) 2025/05/01 02:08:11 DEBUG : pacer: Reducing sleep to 14.465146ms 2025/05/01 02:08:11 INFO : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Moved (server-side) to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences-rclone-move-rasisil9 2025/05/01 02:08:11 DEBUG : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: moving to subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/05/01 02:08:12 DEBUG : pacer: low level retry 1/10 (error too_many_write_operations/.) 2025/05/01 02:08:12 DEBUG : pacer: Rate limited, increasing sleep to 28.930292ms 2025/05/01 02:08:13 DEBUG : pacer: low level retry 2/10 (error too_many_write_operations/.) 2025/05/01 02:08:13 DEBUG : pacer: Rate limited, increasing sleep to 57.860584ms 2025/05/01 02:08:14 DEBUG : pacer: Reducing sleep to 43.395438ms 2025/05/01 02:08:14 INFO : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences-rclone-move-rasisil9: Moved (server-side) to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/05/01 02:08:14 INFO : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Moved (server-side) to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/05/01 02:08:14 INFO : SUBDIRA/subdirb/SUBDIRC/subdird/filewithoutcasedifferences: Fixed case by renaming to: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/05/01 02:08:14 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Waiting for transfers to finish 2025/05/01 02:08:14 DEBUG : pacer: Reducing sleep to 32.546578ms 2025/05/01 02:08:14 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Uploading chunk 1/1 2025/05/01 02:08:15 DEBUG : pacer: Reducing sleep to 24.409933ms 2025/05/01 02:08:15 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Uploading chunk 2/1 2025/05/01 02:08:15 DEBUG : pacer: Reducing sleep to 18.307449ms 2025/05/01 02:08:15 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Adding "subdira/subdirb/subdirc/subdird/filewithoutcasedifferences" to batch 2025/05/01 02:08:16 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Batch idle for 500ms so committing 2025/05/01 02:08:16 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committing sync batch length 1 starting with: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/05/01 02:08:17 DEBUG : pacer: Reducing sleep to 13.730586ms 2025/05/01 02:08:17 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Committed sync batch length 1 starting with: subdira/subdirb/subdirc/subdird/filewithoutcasedifferences 2025/05/01 02:08:17 DEBUG : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: dropbox = 876764f8f7cb4581b40dd4a7a1be217b2c58ae386ca01c86ea0b30bba6d050ed OK 2025/05/01 02:08:17 INFO : subdira/subdirb/subdirc/subdird/filewithoutcasedifferences: Copied (replaced existing) 2025/05/01 02:08:17 ERROR : Dropbox root 'rclone-test-pacojuw2hubu': not deleting files as there were IO errors 2025/05/01 02:08:17 ERROR : Dropbox root 'rclone-test-pacojuw2hubu': not deleting directories as there were IO errors sync_test.go:2655: Error Trace: /home/rclone/go/src/github.com/rclone/rclone/fs/sync/sync_test.go:2655 Error: Received unexpected error: upload failed: batch upload failed: upload failed: too_many_write_operations Test: TestFixCase 2025/05/01 02:08:17 DEBUG : pacer: Reducing sleep to 10.297939ms 2025/05/01 02:08:18 DEBUG : pacer: Reducing sleep to 10ms --- FAIL: TestFixCase (61.70s) FAIL 2025/05/01 02:08:27 DEBUG : Dropbox root 'rclone-test-pacojuw2hubu': Purge remote "./sync.test -test.v -test.timeout 1h0m0s -remote TestDropbox: -verbose -test.run '^TestFixCase$'" - Finished ERROR in 1m2.847711579s (try 2/5): exit status 1: Failed [TestFixCase]