Migrating Data
There are several means to copy data to Fabian. For small files (up to a few GB) the file transfer options within OnDemand or the remote desktop tool will work perfectly well.
For larger transfers the rsync tool or a sftp client, like Cyberduck, are supported.
For long term data storage Onedrive or SharePoint storage should be used and we have installed the rclone tool to help you do that.
What to migrate?
You should not copy up all your data "just in case" or to use Fabian for data storage (OneDrive/SharePoint is a suitable place for that)
We pay for storage, the cost depends on how much data we store. The cost of storage is taken from the budget for running this service so the more storage we use, the less budget is left to pay for compute time to run our jobs.
Migrating a folder from your machine to the new Fabian service
Using a terminal/iterm/command prompt/powershell, go to the parent folder you want to copy from, and use rsync e.g.
cd ~
rsync -av --progress projects fab:
to copy all your projects from your home on-site to your home on the new Fabian.
You can also copy individual files this way.
cd ~
rsync -av --progress projects/econ101/data/big_sheet.csv fab:
to copy the file projects/econ101/data/big_sheet.csv from your home directory to your home on the new Fabian.