"./sync.test -test.v -test.timeout 2h0m0s -remote TestFileFabric: -verbose -test.run '^(TestCopy|TestCopyAfterDelete|TestCopyCheckFirst|TestCopyDeleteBefore|TestCopyEmptyDirectories|TestCopyMissingDirectory|TestCopyNoTraverse|TestCopyRedownload|TestCopyWithDepth|TestCopyWithDryRun|TestCopyWithFilesFrom|TestCopyWithFilesFromAndNoTraverse|TestMoveEmptyDirectories|TestMoveWithDeleteEmptySrcDirs|TestMoveWithIgnoreExisting|TestMoveWithoutDeleteEmptySrcDirs|TestServerSideCopy|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveWithFilter|TestSyncAfterAddingAFile|TestSyncAfterChangingContentsOnly|TestSyncAfterChangingFilesSizeOnly|TestSyncAfterChangingModtimeOnly|TestSyncAfterRemovingAFileAndAddingAFile|TestSyncAfterRemovingAFileAndAddingAFileDryRun|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors|TestSyncBackupDir|TestSyncBackupDirSuffixOnly|TestSyncBackupDirWithSuffix|TestSyncBackupDirWithSuffixKeepExtension|TestSyncBasedOnCheckSum|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncCopyDest|TestSyncDeleteBefore|TestSyncDeleteDuring|TestSyncDoesntUpdateModtime|TestSyncEmptyDirectories|TestSyncIgnoreErrors|TestSyncIgnoreExisting|TestSyncIgnoreSize|TestSyncIgnoreTimes|TestSyncImmutable|TestSyncMultipleCompareDest|TestSyncNoTraverse|TestSyncSizeOnly|TestSyncSuffix|TestSyncSuffixKeepExtension|TestSyncUTFNorm|TestSyncWithExclude|TestSyncWithExcludeAndDeleteExcluded|TestSyncWithTrackRenames|TestSyncWithTrackRenamesStrategyLeaf|TestSyncWithTrackRenamesStrategyModtime|TestSyncWithUpdateOlder)$'" - Starting (try 2/5) 2022/05/18 05:29:44 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-xucecef7goludez9qekujoc3" 2022/05/18 05:29:44 DEBUG : Using config file from "/home/rclone/.rclone.conf" 2022/05/18 05:29:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: checkPathExists(map[path:rclone-test-xucecef7goludez9qekujoc3 pid:120673762]) options=[] 2022/05/18 05:29:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:45 DEBUG : Creating backend with remote "/tmp/rclone2157771550" === RUN TestCopyWithDryRun run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:29:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:29:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:29:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:47 ERROR : : error listing: directory not found --- FAIL: TestCopyWithDryRun (2.70s) === RUN TestCopy run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:29:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:29:49 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:29:49 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:50 ERROR : : error listing: directory not found --- FAIL: TestCopy (2.78s) === RUN TestCopyMissingDirectory run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:29:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:51 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:51 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:29:52 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:29:52 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:53 ERROR : : error listing: directory not found --- FAIL: TestCopyMissingDirectory (2.85s) === RUN TestCopyNoTraverse run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:29:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:29:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:29:54 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:54 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:29:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:29:56 ERROR : sub dir/hello world: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:98: Error Trace: sync_test.go:98 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyNoTraverse 2022/05/18 05:29:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:56 ERROR : : error listing: directory not found --- FAIL: TestCopyNoTraverse (3.27s) === RUN TestCopyCheckFirst run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:29:56 INFO : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Running all checks before starting transfers 2022/05/18 05:29:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:57 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:57 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:29:57 INFO : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Checks finished, now starting transfers 2022/05/18 05:29:57 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:29:57 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:57 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:57 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:29:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:29:59 ERROR : sub dir/hello world: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:116: Error Trace: sync_test.go:116 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyCheckFirst 2022/05/18 05:29:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:29:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:29:59 ERROR : : error listing: directory not found --- FAIL: TestCopyCheckFirst (3.33s) === RUN TestSyncNoTraverse run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:29:59 ERROR : Ignoring --no-traverse with sync 2022/05/18 05:29:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:01 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:01 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:02 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:02 ERROR : sub dir/hello world: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:02 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:30:02 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:135: Error Trace: sync_test.go:135 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncNoTraverse 2022/05/18 05:30:02 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:03 ERROR : : error listing: directory not found --- FAIL: TestSyncNoTraverse (3.33s) === RUN TestCopyWithDepth run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:04 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:04 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:05 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:05 ERROR : hello world2: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:154: Error Trace: sync_test.go:154 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyWithDepth 2022/05/18 05:30:05 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:06 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:06 ERROR : : error listing: directory not found --- FAIL: TestCopyWithDepth (3.29s) === RUN TestCopyWithFilesFrom run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:06 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:06 DEBUG : hello world2: Excluded 2022/05/18 05:30:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:09 ERROR : potato2: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:181: Error Trace: sync_test.go:181 sync_test.go:186 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyWithFilesFrom 2022/05/18 05:30:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:09 ERROR : : error listing: directory not found --- FAIL: TestCopyWithFilesFrom (3.26s) === RUN TestCopyWithFilesFromAndNoTraverse run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:10 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:10 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:10 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:10 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:11 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:11 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:12 ERROR : potato2: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:181: Error Trace: sync_test.go:181 sync_test.go:187 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestCopyWithFilesFromAndNoTraverse 2022/05/18 05:30:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:13 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:13 ERROR : : error listing: directory not found --- FAIL: TestCopyWithFilesFromAndNoTraverse (3.27s) === RUN TestCopyEmptyDirectories run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:13 DEBUG : sub dir2: Making directory 2022/05/18 05:30:13 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:13 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:13 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:15 ERROR : : error listing: directory not found --- FAIL: TestCopyEmptyDirectories (2.73s) === RUN TestMoveEmptyDirectories run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:15 DEBUG : sub dir2: Making directory 2022/05/18 05:30:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:18 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:18 ERROR : : error listing: directory not found --- FAIL: TestMoveEmptyDirectories (2.72s) === RUN TestSyncEmptyDirectories run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:18 DEBUG : sub dir2: Making directory 2022/05/18 05:30:18 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:19 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:19 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:20 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:20 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:21 ERROR : : error listing: directory not found --- FAIL: TestSyncEmptyDirectories (2.71s) === RUN TestServerSideCopy run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:23 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:23 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:24 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:24 ERROR : : error listing: directory not found --- FAIL: TestServerSideCopy (2.73s) === RUN TestCopyAfterDelete run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:24 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:24 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:24 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:26 ERROR : : error listing: directory not found --- FAIL: TestCopyAfterDelete (2.73s) === RUN TestCopyRedownload run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:27 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:27 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:29 ERROR : : error listing: directory not found --- FAIL: TestCopyRedownload (2.66s) === RUN TestSyncBasedOnCheckSum run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:32 ERROR : check sum: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:32 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:30:32 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:333: Error Trace: sync_test.go:333 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncBasedOnCheckSum 2022/05/18 05:30:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:32 ERROR : : error listing: directory not found --- FAIL: TestSyncBasedOnCheckSum (3.30s) === RUN TestSyncSizeOnly run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:35 ERROR : sizeonly: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:35 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:30:35 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:368: Error Trace: sync_test.go:368 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncSizeOnly 2022/05/18 05:30:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:36 ERROR : : error listing: directory not found --- FAIL: TestSyncSizeOnly (3.29s) === RUN TestSyncIgnoreSize run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:37 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:37 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:38 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:38 ERROR : ignore-size: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:38 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:30:38 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:403: Error Trace: sync_test.go:403 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncIgnoreSize 2022/05/18 05:30:38 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:39 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreSize (3.35s) === RUN TestSyncIgnoreTimes run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:41 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:41 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:42 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreTimes (2.76s) === RUN TestSyncIgnoreExisting run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:30:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:30:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:43 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:43 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:44 ERROR : existing: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:44 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:30:44 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:464: Error Trace: sync_test.go:464 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncIgnoreExisting 2022/05/18 05:30:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:45 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreExisting (3.35s) === RUN TestSyncIgnoreErrors run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:46 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:46 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:48 ERROR : : error listing: directory not found --- FAIL: TestSyncIgnoreErrors (2.68s) === RUN TestSyncAfterChangingModtimeOnly run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:50 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterChangingModtimeOnly (2.67s) === RUN TestSyncDoesntUpdateModtime run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:51 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:51 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:52 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:52 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:53 ERROR : : error listing: directory not found --- FAIL: TestSyncDoesntUpdateModtime (2.71s) === RUN TestSyncAfterAddingAFile run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:54 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:54 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:55 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:55 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:56 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterAddingAFile (2.71s) === RUN TestSyncAfterChangingFilesSizeOnly run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:30:58 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:30:58 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:58 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:58 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterChangingFilesSizeOnly (2.72s) === RUN TestSyncAfterChangingContentsOnly run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:30:58 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:30:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:30:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:01 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:01 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:01 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:01 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterChangingContentsOnly (2.73s) === RUN TestSyncAfterRemovingAFileAndAddingAFileDryRun run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:01 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:02 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:02 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:04 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:04 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileDryRun (2.76s) === RUN TestSyncAfterRemovingAFileAndAddingAFile run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:04 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:05 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:05 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:06 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:06 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:07 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFile (2.67s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDir run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:09 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileSubDir (2.76s) === RUN TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:10 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:10 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:11 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:11 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:12 ERROR : : error listing: directory not found --- FAIL: TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors (2.70s) === RUN TestSyncDeleteDuring run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:13 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:13 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:14 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:14 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:15 ERROR : : error listing: directory not found --- FAIL: TestSyncDeleteDuring (2.68s) === RUN TestSyncDeleteBefore run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:17 ERROR : : error listing: directory not found --- FAIL: TestSyncDeleteBefore (2.68s) === RUN TestCopyDeleteBefore run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:18 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:18 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:19 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:19 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:20 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:20 ERROR : : error listing: directory not found --- FAIL: TestCopyDeleteBefore (2.71s) === RUN TestSyncWithExclude run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:20 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:22 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:22 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:23 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:23 ERROR : : error listing: directory not found --- FAIL: TestSyncWithExclude (2.68s) === RUN TestSyncWithExcludeAndDeleteExcluded run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:23 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:23 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:23 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:25 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:25 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:26 ERROR : : error listing: directory not found --- FAIL: TestSyncWithExcludeAndDeleteExcluded (2.74s) === RUN TestSyncWithUpdateOlder run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:26 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:28 ERROR : : error listing: directory not found --- FAIL: TestSyncWithUpdateOlder (2.72s) === RUN TestSyncWithTrackRenames run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" sync_test.go:1058: Can track renames: false 2022/05/18 05:31:28 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Ignoring --track-renames as the source and destination do not have a common hash 2022/05/18 05:31:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:31:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:31:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:31 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:31 ERROR : potato: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:31 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:33 ERROR : yam: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:33 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:31:33 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:1064: Error Trace: sync_test.go:1064 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncWithTrackRenames 2022/05/18 05:31:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:34 ERROR : : error listing: directory not found --- FAIL: TestSyncWithTrackRenames (5.40s) === RUN TestSyncWithTrackRenamesStrategyModtime run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" sync_test.go:1127: Can track renames: true 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:34 INFO : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Making map for --track-renames 2022/05/18 05:31:34 INFO : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Finished making map for --track-renames 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for renames to finish 2022/05/18 05:31:34 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:31:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:36 ERROR : potato: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:37 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:37 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:38 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:38 ERROR : yam: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:38 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:31:38 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:1133: Error Trace: sync_test.go:1133 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncWithTrackRenamesStrategyModtime 2022/05/18 05:31:38 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:39 ERROR : : error listing: directory not found --- FAIL: TestSyncWithTrackRenamesStrategyModtime (5.40s) === RUN TestSyncWithTrackRenamesStrategyLeaf run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" sync_test.go:1163: Can track renames: true 2022/05/18 05:31:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:40 INFO : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Making map for --track-renames 2022/05/18 05:31:40 INFO : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Finished making map for --track-renames 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for renames to finish 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:42 ERROR : potato: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:44 ERROR : sub/yam: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:44 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:31:44 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:1169: Error Trace: sync_test.go:1169 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncWithTrackRenamesStrategyLeaf 2022/05/18 05:31:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:44 ERROR : : error listing: directory not found --- FAIL: TestSyncWithTrackRenamesStrategyLeaf (5.41s) === RUN TestMoveWithDeleteEmptySrcDirs run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:47 ERROR : : error listing: directory not found --- FAIL: TestMoveWithDeleteEmptySrcDirs (2.67s) === RUN TestMoveWithoutDeleteEmptySrcDirs run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:49 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:49 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:50 ERROR : : error listing: directory not found --- FAIL: TestMoveWithoutDeleteEmptySrcDirs (2.69s) === RUN TestMoveWithIgnoreExisting run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:31:50 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:31:51 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:51 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:53 ERROR : existing: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:53 ERROR : existing: Not deleting source as copy failed: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:53 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:55 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:55 ERROR : existing-b: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:55 ERROR : existing-b: Not deleting source as copy failed: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) sync_test.go:1323: Error Trace: sync_test.go:1323 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestMoveWithIgnoreExisting 2022/05/18 05:31:55 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:55 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:55 ERROR : : error listing: directory not found --- FAIL: TestMoveWithIgnoreExisting (5.41s) === RUN TestServerSideMove run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:55 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-jiyeluk9yeqihim4hedason8" 2022/05/18 05:31:55 DEBUG : filefabric root 'rclone-test-jiyeluk9yeqihim4hedason8': rpc: checkPathExists(map[path:rclone-test-jiyeluk9yeqihim4hedason8 pid:120673762]) options=[] 2022/05/18 05:31:56 DEBUG : filefabric root 'rclone-test-jiyeluk9yeqihim4hedason8': >rpc: result=Success (ok), err= 2022/05/18 05:31:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:56 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:31:58 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:31:58 DEBUG : filefabric root 'rclone-test-jiyeluk9yeqihim4hedason8': Purge remote 2022/05/18 05:31:58 DEBUG : filefabric root 'rclone-test-jiyeluk9yeqihim4hedason8': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:58 DEBUG : filefabric root 'rclone-test-jiyeluk9yeqihim4hedason8': >rpc: result=Success (ok), err= 2022/05/18 05:31:58 purge failed: directory not found 2022/05/18 05:31:58 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:31:59 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:31:59 ERROR : : error listing: directory not found --- FAIL: TestServerSideMove (3.78s) === RUN TestServerSideMoveWithFilter run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:31:59 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-majokaz2kofupec3xozekak5" 2022/05/18 05:31:59 DEBUG : filefabric root 'rclone-test-majokaz2kofupec3xozekak5': rpc: checkPathExists(map[path:rclone-test-majokaz2kofupec3xozekak5 pid:120673762]) options=[] 2022/05/18 05:32:00 DEBUG : filefabric root 'rclone-test-majokaz2kofupec3xozekak5': >rpc: result=Success (ok), err= 2022/05/18 05:32:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:00 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:02 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:02 DEBUG : filefabric root 'rclone-test-majokaz2kofupec3xozekak5': Purge remote 2022/05/18 05:32:02 DEBUG : filefabric root 'rclone-test-majokaz2kofupec3xozekak5': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:02 DEBUG : filefabric root 'rclone-test-majokaz2kofupec3xozekak5': >rpc: result=Success (ok), err= 2022/05/18 05:32:02 purge failed: directory not found 2022/05/18 05:32:02 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:03 ERROR : : error listing: directory not found --- FAIL: TestServerSideMoveWithFilter (3.81s) === RUN TestServerSideMoveDeleteEmptySourceDirs run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:03 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-suwajiy7vageqew9zinoyiq3" 2022/05/18 05:32:03 DEBUG : filefabric root 'rclone-test-suwajiy7vageqew9zinoyiq3': rpc: checkPathExists(map[path:rclone-test-suwajiy7vageqew9zinoyiq3 pid:120673762]) options=[] 2022/05/18 05:32:03 DEBUG : filefabric root 'rclone-test-suwajiy7vageqew9zinoyiq3': >rpc: result=Success (ok), err= 2022/05/18 05:32:03 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:04 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:04 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:05 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:05 DEBUG : filefabric root 'rclone-test-suwajiy7vageqew9zinoyiq3': Purge remote 2022/05/18 05:32:05 DEBUG : filefabric root 'rclone-test-suwajiy7vageqew9zinoyiq3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:06 DEBUG : filefabric root 'rclone-test-suwajiy7vageqew9zinoyiq3': >rpc: result=Success (ok), err= 2022/05/18 05:32:06 purge failed: directory not found 2022/05/18 05:32:06 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:07 ERROR : : error listing: directory not found --- FAIL: TestServerSideMoveDeleteEmptySourceDirs (3.83s) === RUN TestSyncCompareDest run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:07 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-xucecef7goludez9qekujoc3/dst" 2022/05/18 05:32:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: checkPathExists(map[path:rclone-test-xucecef7goludez9qekujoc3/dst pid:120673762]) options=[] 2022/05/18 05:32:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Success (ok), err= 2022/05/18 05:32:07 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-xucecef7goludez9qekujoc3/CompareDest" 2022/05/18 05:32:07 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CompareDest': rpc: checkPathExists(map[path:rclone-test-xucecef7goludez9qekujoc3/CompareDest pid:120673762]) options=[] 2022/05/18 05:32:08 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CompareDest': >rpc: result=Success (ok), err= 2022/05/18 05:32:08 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:08 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Success (ok), err= 2022/05/18 05:32:08 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CompareDest': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CompareDest': >rpc: result=Success (ok), err= 2022/05/18 05:32:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': Waiting for checks to finish 2022/05/18 05:32:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': Waiting for transfers to finish 2022/05/18 05:32:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Success (ok), err= 2022/05/18 05:32:09 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:11 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:11 ERROR : one: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:11 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': not deleting files as there were IO errors 2022/05/18 05:32:11 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': not deleting directories as there were IO errors sync_test.go:1463: Error Trace: sync_test.go:1463 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncCompareDest 2022/05/18 05:32:11 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:12 ERROR : : error listing: directory not found --- FAIL: TestSyncCompareDest (4.83s) === RUN TestSyncMultipleCompareDest run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:12 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:14 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:14 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:14 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:14 ERROR : : error listing: directory not found --- FAIL: TestSyncMultipleCompareDest (2.71s) === RUN TestSyncCopyDest run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:14 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-xucecef7goludez9qekujoc3/dst" 2022/05/18 05:32:14 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: checkPathExists(map[path:rclone-test-xucecef7goludez9qekujoc3/dst pid:120673762]) options=[] 2022/05/18 05:32:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Success (ok), err= 2022/05/18 05:32:15 DEBUG : Creating backend with remote "TestFileFabric:rclone-test-xucecef7goludez9qekujoc3/CopyDest" 2022/05/18 05:32:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CopyDest': rpc: checkPathExists(map[path:rclone-test-xucecef7goludez9qekujoc3/CopyDest pid:120673762]) options=[] 2022/05/18 05:32:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CopyDest': >rpc: result=Success (ok), err= 2022/05/18 05:32:15 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Success (ok), err= 2022/05/18 05:32:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CopyDest': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/CopyDest': >rpc: result=Success (ok), err= 2022/05/18 05:32:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': Waiting for checks to finish 2022/05/18 05:32:16 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': Waiting for transfers to finish 2022/05/18 05:32:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Success (ok), err= 2022/05/18 05:32:17 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:18 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:18 ERROR : one: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:18 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': not deleting files as there were IO errors 2022/05/18 05:32:18 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3/dst': not deleting directories as there were IO errors sync_test.go:1615: Error Trace: sync_test.go:1615 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncCopyDest 2022/05/18 05:32:18 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:19 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:19 ERROR : : error listing: directory not found --- FAIL: TestSyncCopyDest (4.88s) === RUN TestSyncBackupDir run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:19 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:20 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:20 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:21 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:22 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:22 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDir (2.67s) === RUN TestSyncBackupDirWithSuffix run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:22 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:22 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:22 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:24 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:24 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:25 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:25 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDirWithSuffix (2.75s) === RUN TestSyncBackupDirWithSuffixKeepExtension run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:25 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:25 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:25 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:27 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:27 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:27 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:27 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDirWithSuffixKeepExtension (2.68s) === RUN TestSyncBackupDirSuffixOnly run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:27 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:28 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:29 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:30 ERROR : : error listing: directory not found --- FAIL: TestSyncBackupDirSuffixOnly (2.66s) === RUN TestSyncSuffix run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:30 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:32 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:33 ERROR : : error listing: directory not found --- FAIL: TestSyncSuffix (2.70s) === RUN TestSyncSuffixKeepExtension run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:33 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:35 ERROR : : error listing: directory not found --- FAIL: TestSyncSuffixKeepExtension (2.72s) === RUN TestSyncUTFNorm run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:35 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:36 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:37 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:37 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:38 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:38 ERROR : : error listing: directory not found --- FAIL: TestSyncUTFNorm (2.71s) === RUN TestSyncImmutable run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:38 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:39 ERROR : : error listing: directory not found 2022/05/18 05:32:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for checks to finish 2022/05/18 05:32:39 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Waiting for transfers to finish 2022/05/18 05:32:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:40 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:41 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:41 ERROR : existing: Failed to copy: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:41 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting files as there were IO errors 2022/05/18 05:32:41 ERROR : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': not deleting directories as there were IO errors sync_test.go:1929: Error Trace: sync_test.go:1929 Error: Received unexpected error: failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) Test: TestSyncImmutable 2022/05/18 05:32:41 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:42 ERROR : : error listing: directory not found --- FAIL: TestSyncImmutable (4.03s) === RUN TestSyncConcurrentDelete run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:42 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:43 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:43 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:44 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:45 ERROR : : error listing: directory not found --- FAIL: TestSyncConcurrentDelete (2.79s) === RUN TestSyncConcurrentTruncate run.go:181: Remote "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'", Local "Local file system at /tmp/rclone2157771550", Modify Window "1s" 2022/05/18 05:32:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:45 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: doCreateNewFolder(map[fi_name:rclone-test-xucecef7goludez9qekujoc3 fi_pid:120673762]) options=[] 2022/05/18 05:32:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data), err=Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) run.go:239: Failed to mkdir "filefabric root 'rclone-test-xucecef7goludez9qekujoc3'": failed to make directory: failed to create directory: Open S3 provider access error. Message from Open S3 provider: "Unexpected response code 503". (error_data) 2022/05/18 05:32:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:47 ERROR : : error listing: directory not found --- FAIL: TestSyncConcurrentTruncate (2.69s) FAIL 2022/05/18 05:32:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': Purge remote 2022/05/18 05:32:47 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': rpc: getFolderContents(map[count:1000 fi_pid:120673762 options:filelist|fi_id|fi_pid|fi_name|fi_type|fi_size|fi_contenttype|fi_modified|fi_localtime|trash|subfolders subfolders:y]) options=[] 2022/05/18 05:32:48 DEBUG : filefabric root 'rclone-test-xucecef7goludez9qekujoc3': >rpc: result=Success (ok), err= 2022/05/18 05:32:48 purge failed: directory not found "./sync.test -test.v -test.timeout 2h0m0s -remote TestFileFabric: -verbose -test.run '^(TestCopy|TestCopyAfterDelete|TestCopyCheckFirst|TestCopyDeleteBefore|TestCopyEmptyDirectories|TestCopyMissingDirectory|TestCopyNoTraverse|TestCopyRedownload|TestCopyWithDepth|TestCopyWithDryRun|TestCopyWithFilesFrom|TestCopyWithFilesFromAndNoTraverse|TestMoveEmptyDirectories|TestMoveWithDeleteEmptySrcDirs|TestMoveWithIgnoreExisting|TestMoveWithoutDeleteEmptySrcDirs|TestServerSideCopy|TestServerSideMove|TestServerSideMoveDeleteEmptySourceDirs|TestServerSideMoveWithFilter|TestSyncAfterAddingAFile|TestSyncAfterChangingContentsOnly|TestSyncAfterChangingFilesSizeOnly|TestSyncAfterChangingModtimeOnly|TestSyncAfterRemovingAFileAndAddingAFile|TestSyncAfterRemovingAFileAndAddingAFileDryRun|TestSyncAfterRemovingAFileAndAddingAFileSubDir|TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors|TestSyncBackupDir|TestSyncBackupDirSuffixOnly|TestSyncBackupDirWithSuffix|TestSyncBackupDirWithSuffixKeepExtension|TestSyncBasedOnCheckSum|TestSyncCompareDest|TestSyncConcurrentDelete|TestSyncConcurrentTruncate|TestSyncCopyDest|TestSyncDeleteBefore|TestSyncDeleteDuring|TestSyncDoesntUpdateModtime|TestSyncEmptyDirectories|TestSyncIgnoreErrors|TestSyncIgnoreExisting|TestSyncIgnoreSize|TestSyncIgnoreTimes|TestSyncImmutable|TestSyncMultipleCompareDest|TestSyncNoTraverse|TestSyncSizeOnly|TestSyncSuffix|TestSyncSuffixKeepExtension|TestSyncUTFNorm|TestSyncWithExclude|TestSyncWithExcludeAndDeleteExcluded|TestSyncWithTrackRenames|TestSyncWithTrackRenamesStrategyLeaf|TestSyncWithTrackRenamesStrategyModtime|TestSyncWithUpdateOlder)$'" - Finished ERROR in 3m4.07730278s (try 2/5): exit status 1: Failed [TestCopyWithDryRun TestCopy TestCopyMissingDirectory TestCopyNoTraverse TestCopyCheckFirst TestSyncNoTraverse TestCopyWithDepth TestCopyWithFilesFrom TestCopyWithFilesFromAndNoTraverse TestCopyEmptyDirectories TestMoveEmptyDirectories TestSyncEmptyDirectories TestServerSideCopy TestCopyAfterDelete TestCopyRedownload TestSyncBasedOnCheckSum TestSyncSizeOnly TestSyncIgnoreSize TestSyncIgnoreTimes TestSyncIgnoreExisting TestSyncIgnoreErrors TestSyncAfterChangingModtimeOnly TestSyncDoesntUpdateModtime TestSyncAfterAddingAFile TestSyncAfterChangingFilesSizeOnly TestSyncAfterChangingContentsOnly TestSyncAfterRemovingAFileAndAddingAFileDryRun TestSyncAfterRemovingAFileAndAddingAFile TestSyncAfterRemovingAFileAndAddingAFileSubDir TestSyncAfterRemovingAFileAndAddingAFileSubDirWithErrors TestSyncDeleteDuring TestSyncDeleteBefore TestCopyDeleteBefore TestSyncWithExclude TestSyncWithExcludeAndDeleteExcluded TestSyncWithUpdateOlder TestSyncWithTrackRenames TestSyncWithTrackRenamesStrategyModtime TestSyncWithTrackRenamesStrategyLeaf TestMoveWithDeleteEmptySrcDirs TestMoveWithoutDeleteEmptySrcDirs TestMoveWithIgnoreExisting TestServerSideMove TestServerSideMoveWithFilter TestServerSideMoveDeleteEmptySourceDirs TestSyncCompareDest TestSyncMultipleCompareDest TestSyncCopyDest TestSyncBackupDir TestSyncBackupDirWithSuffix TestSyncBackupDirWithSuffixKeepExtension TestSyncBackupDirSuffixOnly TestSyncSuffix TestSyncSuffixKeepExtension TestSyncUTFNorm TestSyncImmutable TestSyncConcurrentDelete TestSyncConcurrentTruncate]