"./sync.test -test.v -test.timeout 2h0m0s -remote TestFileFabric: -verbose -test.run '^(TestCopy|TestCopyAfterDelete|TestCopyCheckFirst|TestCopyDeleteBefore|TestCopyEmptyDirectories|TestCopyMissingDirectory|TestCopyNoTraverse|TestCopyRedownload|TestCopyWithDepth|TestCopyWithDryRun|TestCopyWithFilesFrom|TestCopyWithFilesFromAndNoTraverse|TestMoveEmptyDirectories|TestMoveWithDeleteEmptySrcDirs|TestMoveWithIgnoreExisting|TestMoveWithoutDeleteEmptySrcDirs|TestServerSideCopy|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveWithFilter|TestSyncAfterAddingAFile|TestSyncAfterChangingContentsOnly|TestSyncAfterChangingFilesSizeOnly|TestSyncAfterChangingModtimeOnly|TestSyncAfterRemovingAFileAndAddingAFile|TestSyncAfterRemovingAFileAndAddingAFileDryRun|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors|TestSyncBackupDir|TestSyncBackupDirSuffixOnly|TestSyncBackupDirWithSuffix|TestSyncBackupDirWithSuffixKeepExtension|TestSyncBasedOnCheckSum|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncCopyDest|TestSyncDeleteBefore|TestSyncDeleteDuring|TestSyncDoesntUpdateModtime|TestSyncEmptyDirectories|TestSyncIgnoreErrors|TestSyncIgnoreExisting|TestSyncIgnoreSize|TestSyncIgnoreTimes|TestSyncImmutable|TestSyncMultipleCompareDest|TestSyncNoTraverse|TestSyncSizeOnly|TestSyncSuffix|TestSyncSuffixKeepExtension|TestSyncUTFNorm|TestSyncWithExclude|TestSyncWithExcludeAndDeleteExcluded|TestSyncWithTrackRenames|TestSyncWithTrackRenamesStrategyLeaf|TestSyncWithTrackRenamesStrategyModtime|TestSyncWithUpdateOlder)$'" - Starting (try 5/5) 2022/05/18 05:38:56 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-woqicem1goyusok6jagosow4" 2022/05/18 05:38:56 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/05/18 05:38:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: checkPathExists(map[path:rclone-test-woqicem1goyusok6jagosow4 pid:120673762]) options=[] 2022/05/18 05:38:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:38:56 DEBUG : Creating backend with remote "/tmp/rclone3928191444" === RUN TestCopyWithDryRun run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:38:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:38:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:38:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:38:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:38:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:38:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:38:59 ERROR : : error listing: directory not found --- FAIL: TestCopyWithDryRun (2.68s) === RUN TestCopy run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:38:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:38:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:38:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:01 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:01 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:02 ERROR : : error listing: directory not found --- FAIL: TestCopy (2.83s) === RUN TestCopyMissingDirectory run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:04 ERROR : : error listing: directory not found --- FAIL: TestCopyMissingDirectory (2.69s) === RUN TestCopyNoTraverse run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:05 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:05 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:05 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:05 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:07 ERROR : sub dir/hello world: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:98: Error Trace: sync_test.go:98 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyNoTraverse 2022/05/18 05:39:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:08 ERROR : : error listing: directory not found --- FAIL: TestCopyNoTraverse (3.30s) === RUN TestCopyCheckFirst run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:08 INFO : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Running all checks before starting transfers 2022/05/18 05:39:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:08 INFO : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Checks finished, now starting transfers 2022/05/18 05:39:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:09 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:09 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:10 ERROR : sub dir/hello world: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:116: Error Trace: sync_test.go:116 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyCheckFirst 2022/05/18 05:39:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:11 ERROR : : error listing: directory not found --- FAIL: TestCopyCheckFirst (3.25s) === RUN TestSyncNoTraverse run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:11 ERROR : Ignoring --no-traverse with sync 2022/05/18 05:39:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:12 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:12 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:14 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:14 ERROR : sub dir/hello world: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:14 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:39:14 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:135: Error Trace: sync_test.go:135 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncNoTraverse 2022/05/18 05:39:14 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:14 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:14 ERROR : : error listing: directory not found --- FAIL: TestSyncNoTraverse (3.32s) === RUN TestCopyWithDepth run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:14 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:17 ERROR : hello world2: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:154: Error Trace: sync_test.go:154 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyWithDepth 2022/05/18 05:39:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:17 ERROR : : error listing: directory not found --- FAIL: TestCopyWithDepth (3.31s) === RUN TestCopyWithFilesFrom run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:17 DEBUG : hello world2: Excluded 2022/05/18 05:39:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:19 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:19 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:20 ERROR : potato2: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:181: Error Trace: sync_test.go:181 sync_test.go:186 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyWithFilesFrom 2022/05/18 05:39:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:21 ERROR : : error listing: directory not found --- FAIL: TestCopyWithFilesFrom (3.35s) === RUN TestCopyWithFilesFromAndNoTraverse run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:22 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:22 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:24 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:24 ERROR : potato2: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:181: Error Trace: sync_test.go:181 sync_test.go:187 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyWithFilesFromAndNoTraverse 2022/05/18 05:39:24 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:24 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:24 ERROR : : error listing: directory not found --- FAIL: TestCopyWithFilesFromAndNoTraverse (3.27s) === RUN TestCopyEmptyDirectories run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:24 DEBUG : sub dir2: Making directory 2022/05/18 05:39:24 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:27 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:27 ERROR : : error listing: directory not found --- FAIL: TestCopyEmptyDirectories (2.70s) === RUN TestMoveEmptyDirectories run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:27 DEBUG : sub dir2: Making directory 2022/05/18 05:39:27 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:27 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:27 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:29 ERROR : : error listing: directory not found --- FAIL: TestMoveEmptyDirectories (2.66s) === RUN TestSyncEmptyDirectories run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:29 DEBUG : sub dir2: Making directory 2022/05/18 05:39:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:30 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:30 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:32 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:32 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:32 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:32 ERROR : : error listing: directory not found --- FAIL: TestSyncEmptyDirectories (2.70s) === RUN TestServerSideCopy run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:32 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:34 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:34 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:35 ERROR : : error listing: directory not found --- FAIL: TestServerSideCopy (2.66s) === RUN TestCopyAfterDelete run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:38 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:38 ERROR : : error listing: directory not found --- FAIL: TestCopyAfterDelete (2.71s) === RUN TestCopyRedownload run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:38 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:38 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:38 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:40 ERROR : : error listing: directory not found --- FAIL: TestCopyRedownload (2.70s) === RUN TestSyncBasedOnCheckSum run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:43 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:43 ERROR : check sum: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:43 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:39:43 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:333: Error Trace: sync_test.go:333 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncBasedOnCheckSum 2022/05/18 05:39:43 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:44 ERROR : : error listing: directory not found --- FAIL: TestSyncBasedOnCheckSum (3.27s) === RUN TestSyncSizeOnly run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:46 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:46 ERROR : sizeonly: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:46 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:39:46 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:368: Error Trace: sync_test.go:368 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncSizeOnly 2022/05/18 05:39:46 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:47 ERROR : : error listing: directory not found --- FAIL: TestSyncSizeOnly (3.32s) === RUN TestSyncIgnoreSize run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:48 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:48 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:50 ERROR : ignore-size: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:50 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:39:50 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:403: Error Trace: sync_test.go:403 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncIgnoreSize 2022/05/18 05:39:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:50 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreSize (3.30s) === RUN TestSyncIgnoreTimes run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:52 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:52 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:53 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreTimes (2.73s) === RUN TestSyncIgnoreExisting run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:39:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:39:54 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:54 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:56 ERROR : existing: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:56 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:39:56 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:464: Error Trace: sync_test.go:464 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncIgnoreExisting 2022/05/18 05:39:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:56 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreExisting (3.26s) === RUN TestSyncIgnoreErrors run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:39:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:39:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:59 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreErrors (2.70s) === RUN TestSyncAfterChangingModtimeOnly run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:39:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:39:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:39:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:01 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:01 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:02 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterChangingModtimeOnly (2.74s) === RUN TestSyncDoesntUpdateModtime run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:04 ERROR : : error listing: directory not found --- FAIL: TestSyncDoesntUpdateModtime (2.66s) === RUN TestSyncAfterAddingAFile run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:05 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:05 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:07 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterAddingAFile (2.74s) === RUN TestSyncAfterChangingFilesSizeOnly run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:08 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:09 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:09 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:10 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterChangingFilesSizeOnly (2.71s) === RUN TestSyncAfterChangingContentsOnly run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:12 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:12 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:12 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:12 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterChangingContentsOnly (2.72s) === RUN TestSyncAfterRemovingAFileAndAddingAFileDryRun run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:12 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:13 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:13 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:15 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileDryRun (2.68s) === RUN TestSyncAfterRemovingAFileAndAddingAFile run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:16 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:16 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:18 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFile (2.76s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDir run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:21 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileSubDir (2.67s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:23 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors (2.69s) === RUN TestSyncDeleteDuring run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:24 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:24 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:26 ERROR : : error listing: directory not found --- FAIL: TestSyncDeleteDuring (2.65s) === RUN TestSyncDeleteBefore run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:29 ERROR : : error listing: directory not found --- FAIL: TestSyncDeleteBefore (2.70s) === RUN TestCopyDeleteBefore run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:29 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:31 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:31 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:31 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:31 ERROR : : error listing: directory not found --- FAIL: TestCopyDeleteBefore (2.66s) === RUN TestSyncWithExclude run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:31 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:32 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:32 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:34 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:34 ERROR : : error listing: directory not found --- FAIL: TestSyncWithExclude (2.68s) === RUN TestSyncWithExcludeAndDeleteExcluded run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:34 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:36 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:36 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:37 ERROR : : error listing: directory not found --- FAIL: TestSyncWithExcludeAndDeleteExcluded (2.72s) === RUN TestSyncWithUpdateOlder run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:39 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:39 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:39 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:39 ERROR : : error listing: directory not found --- FAIL: TestSyncWithUpdateOlder (2.71s) === RUN TestSyncWithTrackRenames run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" sync_test.go:1058: Can track renames: false 2022/05/18 05:40:39 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Ignoring --track-renames as the source and destination do not have a common hash 2022/05/18 05:40:39 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:40:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:40:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:42 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:42 ERROR : potato: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:42 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:43 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:43 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:44 ERROR : yam: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:44 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:40:44 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:1064: Error Trace: sync_test.go:1064 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncWithTrackRenames 2022/05/18 05:40:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:45 ERROR : : error listing: directory not found --- FAIL: TestSyncWithTrackRenames (5.45s) === RUN TestSyncWithTrackRenamesStrategyModtime run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" sync_test.go:1127: Can track renames: true 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:45 INFO : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Making map for --track-renames 2022/05/18 05:40:45 INFO : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Finished making map for --track-renames 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for renames to finish 2022/05/18 05:40:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:40:46 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:46 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:47 ERROR : potato: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:48 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:48 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:50 ERROR : yam: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:50 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:40:50 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:1133: Error Trace: sync_test.go:1133 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncWithTrackRenamesStrategyModtime 2022/05/18 05:40:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:50 ERROR : : error listing: directory not found --- FAIL: TestSyncWithTrackRenamesStrategyModtime (5.41s) === RUN TestSyncWithTrackRenamesStrategyLeaf run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" sync_test.go:1163: Can track renames: true 2022/05/18 05:40:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:51 INFO : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Making map for --track-renames 2022/05/18 05:40:51 INFO : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Finished making map for --track-renames 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for renames to finish 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:53 ERROR : sub/yam: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:55 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:55 ERROR : potato: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:55 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:40:55 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:1169: Error Trace: sync_test.go:1169 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncWithTrackRenamesStrategyLeaf 2022/05/18 05:40:55 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:56 ERROR : : error listing: directory not found --- FAIL: TestSyncWithTrackRenamesStrategyLeaf (5.32s) === RUN TestMoveWithDeleteEmptySrcDirs run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:40:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:40:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:58 ERROR : : error listing: directory not found --- FAIL: TestMoveWithDeleteEmptySrcDirs (2.69s) === RUN TestMoveWithoutDeleteEmptySrcDirs run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:40:58 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:40:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:40:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:00 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:00 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:01 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:01 ERROR : : error listing: directory not found --- FAIL: TestMoveWithoutDeleteEmptySrcDirs (2.69s) === RUN TestMoveWithIgnoreExisting run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:01 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:41:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:41:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:02 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:04 ERROR : existing: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:04 ERROR : existing: Not deleting source as copy failed: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:04 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:06 ERROR : existing-b: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:06 ERROR : existing-b: Not deleting source as copy failed: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:1323: Error Trace: sync_test.go:1323 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestMoveWithIgnoreExisting 2022/05/18 05:41:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:06 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:06 ERROR : : error listing: directory not found --- FAIL: TestMoveWithIgnoreExisting (5.48s) === RUN TestServerSideMove run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:06 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-gonanul6mebahep9sakujuw6" 2022/05/18 05:41:06 DEBUG : filefabric root 'rclone-test-gonanul6mebahep9sakujuw6': rpc: checkPathExists(map[path:rclone-test-gonanul6mebahep9sakujuw6 pid:120673762]) options=[] 2022/05/18 05:41:07 DEBUG : filefabric root 'rclone-test-gonanul6mebahep9sakujuw6': >rpc: result=Success (ok), err= 2022/05/18 05:41:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:07 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:09 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:09 DEBUG : filefabric root 'rclone-test-gonanul6mebahep9sakujuw6': Purge remote 2022/05/18 05:41:09 DEBUG : filefabric root 'rclone-test-gonanul6mebahep9sakujuw6': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:10 DEBUG : filefabric root 'rclone-test-gonanul6mebahep9sakujuw6': >rpc: result=Success (ok), err= 2022/05/18 05:41:10 purge failed: directory not found 2022/05/18 05:41:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:10 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:10 ERROR : : error listing: directory not found --- FAIL: TestServerSideMove (3.76s) === RUN TestServerSideMoveWithFilter run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:10 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-ledevel0coqubun4qihevih7" 2022/05/18 05:41:10 DEBUG : filefabric root 'rclone-test-ledevel0coqubun4qihevih7': rpc: checkPathExists(map[path:rclone-test-ledevel0coqubun4qihevih7 pid:120673762]) options=[] 2022/05/18 05:41:11 DEBUG : filefabric root 'rclone-test-ledevel0coqubun4qihevih7': >rpc: result=Success (ok), err= 2022/05/18 05:41:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:11 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:13 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:13 DEBUG : filefabric root 'rclone-test-ledevel0coqubun4qihevih7': Purge remote 2022/05/18 05:41:13 DEBUG : filefabric root 'rclone-test-ledevel0coqubun4qihevih7': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:13 DEBUG : filefabric root 'rclone-test-ledevel0coqubun4qihevih7': >rpc: result=Success (ok), err= 2022/05/18 05:41:13 purge failed: directory not found 2022/05/18 05:41:13 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:14 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:14 ERROR : : error listing: directory not found --- FAIL: TestServerSideMoveWithFilter (3.80s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:14 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-vodiduh9nukigeq4mesideb9" 2022/05/18 05:41:14 DEBUG : filefabric root 'rclone-test-vodiduh9nukigeq4mesideb9': rpc: checkPathExists(map[path:rclone-test-vodiduh9nukigeq4mesideb9 pid:120673762]) options=[] 2022/05/18 05:41:14 DEBUG : filefabric root 'rclone-test-vodiduh9nukigeq4mesideb9': >rpc: result=Success (ok), err= 2022/05/18 05:41:14 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:15 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:17 DEBUG : filefabric root 'rclone-test-vodiduh9nukigeq4mesideb9': Purge remote 2022/05/18 05:41:17 DEBUG : filefabric root 'rclone-test-vodiduh9nukigeq4mesideb9': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:17 DEBUG : filefabric root 'rclone-test-vodiduh9nukigeq4mesideb9': >rpc: result=Success (ok), err= 2022/05/18 05:41:17 purge failed: directory not found 2022/05/18 05:41:17 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:18 ERROR : : error listing: directory not found --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (3.79s) === RUN TestSyncCompareDest run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:18 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-woqicem1goyusok6jagosow4/dst" 2022/05/18 05:41:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: checkPathExists(map[path:rclone-test-woqicem1goyusok6jagosow4/dst pid:120673762]) options=[] 2022/05/18 05:41:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Success (ok), err= 2022/05/18 05:41:18 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-woqicem1goyusok6jagosow4/CompareDest" 2022/05/18 05:41:18 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CompareDest': rpc: checkPathExists(map[path:rclone-test-woqicem1goyusok6jagosow4/CompareDest pid:120673762]) options=[] 2022/05/18 05:41:19 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CompareDest': >rpc: result=Success (ok), err= 2022/05/18 05:41:19 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:19 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Success (ok), err= 2022/05/18 05:41:19 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CompareDest': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CompareDest': >rpc: result=Success (ok), err= 2022/05/18 05:41:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': Waiting for checks to finish 2022/05/18 05:41:20 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': Waiting for transfers to finish 2022/05/18 05:41:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Success (ok), err= 2022/05/18 05:41:21 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:22 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:22 ERROR : one: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:22 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': not deleting files as there were IO errors 2022/05/18 05:41:22 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': not deleting directories as there were IO errors sync_test.go:1463: Error Trace: sync_test.go:1463 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncCompareDest 2022/05/18 05:41:22 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:23 ERROR : : error listing: directory not found --- FAIL: TestSyncCompareDest (5.01s) === RUN TestSyncMultipleCompareDest run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:23 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:25 ERROR : : error listing: directory not found --- FAIL: TestSyncMultipleCompareDest (2.75s) === RUN TestSyncCopyDest run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:25 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-woqicem1goyusok6jagosow4/dst" 2022/05/18 05:41:25 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: checkPathExists(map[path:rclone-test-woqicem1goyusok6jagosow4/dst pid:120673762]) options=[] 2022/05/18 05:41:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Success (ok), err= 2022/05/18 05:41:26 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-woqicem1goyusok6jagosow4/CopyDest" 2022/05/18 05:41:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CopyDest': rpc: checkPathExists(map[path:rclone-test-woqicem1goyusok6jagosow4/CopyDest pid:120673762]) options=[] 2022/05/18 05:41:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CopyDest': >rpc: result=Success (ok), err= 2022/05/18 05:41:26 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:27 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Success (ok), err= 2022/05/18 05:41:27 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CopyDest': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/CopyDest': >rpc: result=Success (ok), err= 2022/05/18 05:41:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': Waiting for checks to finish 2022/05/18 05:41:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': Waiting for transfers to finish 2022/05/18 05:41:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Success (ok), err= 2022/05/18 05:41:28 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:30 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:30 ERROR : one: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:30 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': not deleting files as there were IO errors 2022/05/18 05:41:30 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4/dst': not deleting directories as there were IO errors sync_test.go:1615: Error Trace: sync_test.go:1615 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncCopyDest 2022/05/18 05:41:30 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:30 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:30 ERROR : : error listing: directory not found --- FAIL: TestSyncCopyDest (4.96s) === RUN TestSyncBackupDir run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:30 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:31 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:31 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:33 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDir (2.71s) === RUN TestSyncBackupDirWithSuffix run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:33 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:34 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:34 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:35 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:36 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:36 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDirWithSuffix (3.21s) === RUN TestSyncBackupDirWithSuffixKeepExtension run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:36 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:37 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:38 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:38 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:39 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:39 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDirWithSuffixKeepExtension (2.68s) === RUN TestSyncBackupDirSuffixOnly run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:39 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:40 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:41 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:42 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:42 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDirSuffixOnly (2.74s) === RUN TestSyncSuffix run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:42 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:42 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:42 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:44 ERROR : : error listing: directory not found --- FAIL: TestSyncSuffix (2.68s) === RUN TestSyncSuffixKeepExtension run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:44 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:45 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:47 ERROR : : error listing: directory not found --- FAIL: TestSyncSuffixKeepExtension (2.73s) === RUN TestSyncUTFNorm run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:47 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:48 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:48 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:49 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:49 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:50 ERROR : : error listing: directory not found --- FAIL: TestSyncUTFNorm (2.79s) === RUN TestSyncImmutable run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:50 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:51 ERROR : : error listing: directory not found 2022/05/18 05:41:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for checks to finish 2022/05/18 05:41:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Waiting for transfers to finish 2022/05/18 05:41:51 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:52 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:52 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:53 ERROR : existing: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:53 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting files as there were IO errors 2022/05/18 05:41:53 ERROR : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': not deleting directories as there were IO errors sync_test.go:1929: Error Trace: sync_test.go:1929 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncImmutable 2022/05/18 05:41:53 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:54 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:54 ERROR : : error listing: directory not found --- FAIL: TestSyncImmutable (3.95s) === RUN TestSyncConcurrentDelete run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:54 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:55 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:55 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:56 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:57 ERROR : : error listing: directory not found --- FAIL: TestSyncConcurrentDelete (2.67s) === RUN TestSyncConcurrentTruncate run.go:181: Remote "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'", Local "Local file system at /tmp/rclone3928191444", Modify Window "1s" 2022/05/18 05:41:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:57 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: doCreateNewFolder(map[fi_name:rclone-test-woqicem1goyusok6jagosow4 fi_pid:120673762]) options=[] 2022/05/18 05:41:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-woqicem1goyusok6jagosow4'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:41:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:41:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:41:59 ERROR : : error listing: directory not found --- FAIL: TestSyncConcurrentTruncate (2.70s) FAIL 2022/05/18 05:41:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': Purge remote 2022/05/18 05:41:59 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:42:00 DEBUG : filefabric root 'rclone-test-woqicem1goyusok6jagosow4': >rpc: result=Success (ok), err= 2022/05/18 05:42:00 purge failed: directory not found "./sync.test -test.v -test.timeout 2h0m0s -remote TestFileFabric: -verbose -test.run '^(TestCopy|TestCopyAfterDelete|TestCopyCheckFirst|TestCopyDeleteBefore|TestCopyEmptyDirectories|TestCopyMissingDirectory|TestCopyNoTraverse|TestCopyRedownload|TestCopyWithDepth|TestCopyWithDryRun|TestCopyWithFilesFrom|TestCopyWithFilesFromAndNoTraverse|TestMoveEmptyDirectories|TestMoveWithDeleteEmptySrcDirs|TestMoveWithIgnoreExisting|TestMoveWithoutDeleteEmptySrcDirs|TestServerSideCopy|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveWithFilter|TestSyncAfterAddingAFile|TestSyncAfterChangingContentsOnly|TestSyncAfterChangingFilesSizeOnly|TestSyncAfterChangingModtimeOnly|TestSyncAfterRemovingAFileAndAddingAFile|TestSyncAfterRemovingAFileAndAddingAFileDryRun|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors|TestSyncBackupDir|TestSyncBackupDirSuffixOnly|TestSyncBackupDirWithSuffix|TestSyncBackupDirWithSuffixKeepExtension|TestSyncBasedOnCheckSum|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncCopyDest|TestSyncDeleteBefore|TestSyncDeleteDuring|TestSyncDoesntUpdateModtime|TestSyncEmptyDirectories|TestSyncIgnoreErrors|TestSyncIgnoreExisting|TestSyncIgnoreSize|TestSyncIgnoreTimes|TestSyncImmutable|TestSyncMultipleCompareDest|TestSyncNoTraverse|TestSyncSizeOnly|TestSyncSuffix|TestSyncSuffixKeepExtension|TestSyncUTFNorm|TestSyncWithExclude|TestSyncWithExcludeAndDeleteExcluded|TestSyncWithTrackRenames|TestSyncWithTrackRenamesStrategyLeaf|TestSyncWithTrackRenamesStrategyModtime|TestSyncWithUpdateOlder)$'" - Finished ERROR in 3m4.328918406s (try 5/5): exit status 1: Failed [TestCopyWithDryRun TestCopy TestCopyMissingDirectory TestCopyNoTraverse TestCopyCheckFirst TestSyncNoTraverse TestCopyWithDepth TestCopyWithFilesFrom TestCopyWithFilesFromAndNoTraverse TestCopyEmptyDirectories TestMoveEmptyDirectories TestSyncEmptyDirectories TestServerSideCopy TestCopyAfterDelete TestCopyRedownload TestSyncBasedOnCheckSum TestSyncSizeOnly TestSyncIgnoreSize TestSyncIgnoreTimes TestSyncIgnoreExisting TestSyncIgnoreErrors TestSyncAfterChangingModtimeOnly TestSyncDoesntUpdateModtime TestSyncAfterAddingAFile TestSyncAfterChangingFilesSizeOnly TestSyncAfterChangingContentsOnly TestSyncAfterRemovingAFileAndAddingAFileDryRun TestSyncAfterRemovingAFileAndAddingAFile TestSyncAfterRemovingAFileAndAddingAFileSubDir TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors TestSyncDeleteDuring TestSyncDeleteBefore TestCopyDeleteBefore TestSyncWithExclude TestSyncWithExcludeAndDeleteExcluded TestSyncWithUpdateOlder TestSyncWithTrackRenames TestSyncWithTrackRenamesStrategyModtime TestSyncWithTrackRenamesStrategyLeaf TestMoveWithDeleteEmptySrcDirs TestMoveWithoutDeleteEmptySrcDirs TestMoveWithIgnoreExisting TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs TestSyncCompareDest TestSyncMultipleCompareDest TestSyncCopyDest TestSyncBackupDir TestSyncBackupDirWithSuffix TestSyncBackupDirWithSuffixKeepExtension TestSyncBackupDirSuffixOnly TestSyncSuffix TestSyncSuffixKeepExtension TestSyncUTFNorm TestSyncImmutable TestSyncConcurrentDelete TestSyncConcurrentTruncate]