"./sync.test -test.v -test.timeout 30m0s -remote TestB2: -verbose -fast-list -test.run '^(TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveWithFilter)$'" - Starting (try 3/5) === RUN TestServerSideMove 2020/03/09 06:21:38 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ms) 2020/03/09 06:21:38 DEBUG : empty space: Unchanged skipping 2020/03/09 06:21:38 DEBUG : B2 bucket rclone-test-fosejug0jajuhih4ciyivur1: Waiting for checks to finish 2020/03/09 06:21:38 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2020/03/09 06:21:38 INFO : empty space: Deleted 2020/03/09 06:21:38 DEBUG : B2 bucket rclone-test-fosejug0jajuhih4ciyivur1: Waiting for transfers to finish 2020/03/09 06:21:39 DEBUG : potato2: SHA-1 = 9dc7f7d3279715991a22853f5981df582b7f9f6d OK 2020/03/09 06:21:39 INFO : potato2: Copied (server side copy) 2020/03/09 06:21:39 INFO : potato2: Deleted 2020/03/09 06:21:40 DEBUG : potato3: SHA-1 = 568f8850f3c1a384731dbe40c6d72e1dcae342a0 OK 2020/03/09 06:21:40 INFO : potato3: Copied (server side copy) 2020/03/09 06:21:43 INFO : potato3: Deleted 2020/03/09 06:21:45 DEBUG : B2 bucket rclone-test-zayokej8cupigak7hirokew8: Waiting for checks to finish 2020/03/09 06:21:45 DEBUG : B2 bucket rclone-test-zayokej8cupigak7hirokew8: Waiting for transfers to finish 2020/03/09 06:21:45 ERROR : empty space: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:21:45 ERROR : empty space: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:21:45 ERROR : potato2: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:21:45 ERROR : potato2: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:21:46 ERROR : potato3: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:21:46 ERROR : potato3: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:21:46 INFO : There was nothing to transfer 2020/03/09 06:21:46 DEBUG : B2 bucket rclone-test-zayokej8cupigak7hirokew8: Purge remote 2020/03/09 06:21:46 purge failed: directory not found 2020/03/09 06:21:46 DEBUG : B2 bucket rclone-test-fosejug0jajuhih4ciyivur1: Purge remote 2020/03/09 06:21:47 DEBUG : empty space: Deleting (id "4_z7fe27de3f04dbbdb7f080e1b_f11824b95eb05b442_d20200309_m062122_c001_v0001044_t0053") 2020/03/09 06:21:47 DEBUG : potato2: Deleting (id "4_z7fe27de3f04dbbdb7f080e1b_f1061668fe70a307f_d20200309_m062138_c001_v0001128_t0041") 2020/03/09 06:21:47 DEBUG : potato3: Deleting (id "4_z7fe27de3f04dbbdb7f080e1b_f1004f2e8f61a49fc_d20200309_m062138_c001_v0001031_t0015") 2020/03/09 06:21:47 DEBUG : potato3: Deleting (id "4_z7fe27de3f04dbbdb7f080e1b_f11824b95eb05b445_d20200309_m062126_c001_v0001044_t0053") --- FAIL: TestServerSideMove (29.44s) run.go:176: Remote "B2 bucket rclone-test-vezaqaj1suciwus0dizevid1", Local "Local file system at /tmp/rclone031507444", Modify Window "1ms" sync_test.go:1156: Server side move (if possible) B2 bucket rclone-test-vezaqaj1suciwus0dizevid1 -> B2 bucket rclone-test-fosejug0jajuhih4ciyivur1 sync_test.go:1193: Error Trace: sync_test.go:1193 sync_test.go:1258 Error: Received unexpected error: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) Test: TestServerSideMove === RUN TestServerSideMoveWithFilter 2020/03/09 06:21:55 DEBUG : empty space: Excluded from sync (and deletion) 2020/03/09 06:21:55 DEBUG : empty space: Excluded from sync (and deletion) 2020/03/09 06:21:55 DEBUG : B2 bucket rclone-test-pofivep4legejak4supukes0: Waiting for checks to finish 2020/03/09 06:21:55 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2020/03/09 06:21:55 DEBUG : B2 bucket rclone-test-pofivep4legejak4supukes0: Waiting for transfers to finish 2020/03/09 06:21:55 DEBUG : potato2: SHA-1 = 9dc7f7d3279715991a22853f5981df582b7f9f6d OK 2020/03/09 06:21:55 INFO : potato2: Copied (server side copy) 2020/03/09 06:21:56 INFO : potato2: Deleted 2020/03/09 06:22:06 DEBUG : potato3: SHA-1 = 568f8850f3c1a384731dbe40c6d72e1dcae342a0 OK 2020/03/09 06:22:06 INFO : potato3: Copied (server side copy) 2020/03/09 06:22:06 INFO : potato3: Deleted 2020/03/09 06:22:07 DEBUG : empty space: Excluded from sync (and deletion) 2020/03/09 06:22:07 DEBUG : B2 bucket rclone-test-getusib0viloqez4cejojax9: Waiting for checks to finish 2020/03/09 06:22:07 DEBUG : B2 bucket rclone-test-getusib0viloqez4cejojax9: Waiting for transfers to finish 2020/03/09 06:22:07 ERROR : potato2: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:07 ERROR : potato2: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:07 ERROR : potato3: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:07 ERROR : potato3: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:07 INFO : There was nothing to transfer 2020/03/09 06:22:07 DEBUG : B2 bucket rclone-test-getusib0viloqez4cejojax9: Purge remote 2020/03/09 06:22:08 purge failed: directory not found 2020/03/09 06:22:08 DEBUG : B2 bucket rclone-test-pofivep4legejak4supukes0: Purge remote 2020/03/09 06:22:08 DEBUG : empty space: Deleting (id "4_z7f02ede3f04dbbdb7f080e1b_f1062c55693c77a2a_d20200309_m062151_c001_v0001037_t0002") 2020/03/09 06:22:08 DEBUG : potato2: Deleting (id "4_z7f02ede3f04dbbdb7f080e1b_f111a03bd0dfb3f03_d20200309_m062155_c001_v0001130_t0010") 2020/03/09 06:22:08 DEBUG : potato3: Deleting (id "4_z7f02ede3f04dbbdb7f080e1b_f1167799f39b9366e_d20200309_m062205_c001_v0001025_t0027") 2020/03/09 06:22:08 DEBUG : potato3: Deleting (id "4_z7f02ede3f04dbbdb7f080e1b_f1062c55693c77a30_d20200309_m062154_c001_v0001037_t0002") --- FAIL: TestServerSideMoveWithFilter (22.44s) run.go:176: Remote "B2 bucket rclone-test-vezaqaj1suciwus0dizevid1", Local "Local file system at /tmp/rclone031507444", Modify Window "1ms" sync_test.go:1156: Server side move (if possible) B2 bucket rclone-test-vezaqaj1suciwus0dizevid1 -> B2 bucket rclone-test-pofivep4legejak4supukes0 sync_test.go:1193: Error Trace: sync_test.go:1193 sync_test.go:1271 Error: Received unexpected error: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) Test: TestServerSideMoveWithFilter === RUN TestServerSideMoveDeleteEmptySourceDirs 2020/03/09 06:22:37 DEBUG : tomatoDir: Making directory 2020/03/09 06:22:39 DEBUG : empty space: Clearing upload URL because of error: c001_v0001113_t0003 is too busy (503 service_unavailable) 2020/03/09 06:22:39 DEBUG : pacer: low level retry 1/1 (error c001_v0001113_t0003 is too busy (503 service_unavailable)) 2020/03/09 06:22:39 DEBUG : pacer: Rate limited, increasing sleep to 1s 2020/03/09 06:22:41 DEBUG : pacer: Reducing sleep to 500ms 2020/03/09 06:22:42 DEBUG : pacer: Reducing sleep to 250ms 2020/03/09 06:22:43 DEBUG : pacer: Reducing sleep to 125ms 2020/03/09 06:22:43 DEBUG : pacer: Reducing sleep to 62.5ms 2020/03/09 06:22:43 DEBUG : pacer: Reducing sleep to 31.25ms 2020/03/09 06:22:43 DEBUG : empty space: Size and modification time the same (differ by 0s, within tolerance 1ms) 2020/03/09 06:22:43 DEBUG : empty space: Unchanged skipping 2020/03/09 06:22:43 DEBUG : potato3: Sizes differ (src 68 vs dst 60) 2020/03/09 06:22:43 DEBUG : B2 bucket rclone-test-josunag9dotozes3zitudig5: Waiting for checks to finish 2020/03/09 06:22:44 DEBUG : pacer: Reducing sleep to 15.625ms 2020/03/09 06:22:44 DEBUG : potato2: SHA-1 = 9dc7f7d3279715991a22853f5981df582b7f9f6d OK 2020/03/09 06:22:44 INFO : potato2: Copied (server side copy) 2020/03/09 06:22:44 INFO : empty space: Deleted 2020/03/09 06:22:44 DEBUG : B2 bucket rclone-test-josunag9dotozes3zitudig5: Waiting for transfers to finish 2020/03/09 06:22:45 INFO : potato2: Deleted 2020/03/09 06:22:49 DEBUG : pacer: Reducing sleep to 10ms 2020/03/09 06:22:49 DEBUG : potato3: SHA-1 = 568f8850f3c1a384731dbe40c6d72e1dcae342a0 OK 2020/03/09 06:22:49 INFO : potato3: Copied (server side copy) 2020/03/09 06:22:50 INFO : potato3: Deleted 2020/03/09 06:22:51 DEBUG : tomatoDir: Making directory 2020/03/09 06:22:51 DEBUG : B2 bucket rclone-test-kepabus1nafoyak4ritoxog6: Waiting for checks to finish 2020/03/09 06:22:51 DEBUG : B2 bucket rclone-test-kepabus1nafoyak4ritoxog6: Waiting for transfers to finish 2020/03/09 06:22:51 ERROR : empty space: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:51 ERROR : empty space: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:51 ERROR : potato2: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:51 ERROR : potato2: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:52 ERROR : potato3: Failed to copy: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:52 ERROR : potato3: Not deleting source as copy failed: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) 2020/03/09 06:22:52 INFO : There was nothing to transfer 2020/03/09 06:22:52 DEBUG : B2 bucket rclone-test-kepabus1nafoyak4ritoxog6: Purge remote 2020/03/09 06:22:53 purge failed: directory not found 2020/03/09 06:22:53 DEBUG : B2 bucket rclone-test-josunag9dotozes3zitudig5: Purge remote 2020/03/09 06:22:53 DEBUG : empty space: Deleting (id "4_z0f62ad83f05dbbdb7f080e1b_f109eddad87cd3a9a_d20200309_m062242_c001_v0001131_t0054") 2020/03/09 06:22:53 DEBUG : potato2: Deleting (id "4_z0f62ad83f05dbbdb7f080e1b_f1034ad791a46429a_d20200309_m062243_c001_v0001003_t0041") 2020/03/09 06:22:53 DEBUG : potato3: Deleting (id "4_z0f62ad83f05dbbdb7f080e1b_f11717af48ab1ea23_d20200309_m062249_c001_v0001023_t0010") 2020/03/09 06:22:53 DEBUG : potato3: Deleting (id "4_z0f62ad83f05dbbdb7f080e1b_f109eddad87cd3a9c_d20200309_m062242_c001_v0001131_t0054") --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (44.13s) run.go:176: Remote "B2 bucket rclone-test-vezaqaj1suciwus0dizevid1", Local "Local file system at /tmp/rclone031507444", Modify Window "1ms" sync_test.go:1156: Server side move (if possible) B2 bucket rclone-test-vezaqaj1suciwus0dizevid1 -> B2 bucket rclone-test-josunag9dotozes3zitudig5 run.go:278: Retry Put of "empty space" to B2 bucket rclone-test-josunag9dotozes3zitudig5: 1/10 (c001_v0001113_t0003 is too busy (503 service_unavailable)) sync_test.go:1193: Error Trace: sync_test.go:1193 sync_test.go:1278 Error: Received unexpected error: failed to create bucket: The account is already at the maximum bucket count (400 too_many_buckets) Test: TestServerSideMoveDeleteEmptySourceDirs FAIL 2020/03/09 06:22:54 DEBUG : B2 bucket rclone-test-vezaqaj1suciwus0dizevid1: Purge remote 2020/03/09 06:22:55 DEBUG : empty space: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f101711f53d256e95_d20200309_m062243_c001_v0001036_t0057") 2020/03/09 06:22:55 DEBUG : empty space: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3ba_d20200309_m062236_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : empty space: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f1091b05a5894bbdd_d20200309_m062210_c001_v0001025_t0014") 2020/03/09 06:22:55 DEBUG : empty space: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3b0_d20200309_m062149_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : empty space: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f11196c2b1b733118_d20200309_m062138_c001_v0001023_t0009") 2020/03/09 06:22:55 DEBUG : empty space: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3a7_d20200309_m062121_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : potato2: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f107e0bc65d3dce9d_d20200309_m062244_c001_v0001032_t0033") 2020/03/09 06:22:55 DEBUG : potato2: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3b3_d20200309_m062211_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : potato2: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f101a9b79d35c51dd_d20200309_m062155_c001_v0001032_t0024") 2020/03/09 06:22:55 DEBUG : potato2: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3af_d20200309_m062149_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : potato2: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10547afbbd19407a_d20200309_m062139_c001_v0001131_t0043") 2020/03/09 06:22:55 DEBUG : potato2: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3a6_d20200309_m062120_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : potato3: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f1113f6be43b190f5_d20200309_m062250_c001_v0001042_t0051") 2020/03/09 06:22:55 DEBUG : potato3: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3bb_d20200309_m062237_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : potato3: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f1021f943268578db_d20200309_m062206_c001_v0001042_t0021") 2020/03/09 06:22:55 DEBUG : potato3: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3b1_d20200309_m062149_c001_v0001003_t0032") 2020/03/09 06:22:55 DEBUG : potato3: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f1017d9fb796af94f_d20200309_m062140_c001_v0001092_t0032") 2020/03/09 06:22:55 DEBUG : potato3: Deleting (id "4_zff127d53f04dbbdb7f080e1b_f10701002c418b3a8_d20200309_m062121_c001_v0001003_t0032") "./sync.test -test.v -test.timeout 30m0s -remote TestB2: -verbose -fast-list -test.run '^(TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveWithFilter)$'" - Finished ERROR in 1m38.140149713s (try 3/5): exit status 1: Failed [TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs]