6) Transferring Files

Files can be transferred to/from your Sabalcore account in several ways.

In this article you will find information for:

Transfer using  SFTP

To transfer a file simply select “Tools –> SFTP File Transfers…” from the Sabalcore ssClient drop down menu.

Your local PC is represented in the left pane, your Sabalcore account in the right pane. Select your files and folders and issue the transfer using the buttons between the two panes. For large files, use GFT.

Transfer using  a browser

Start or open a Sabalcore Remote Desktop (Tools –> Remote Desktop). From the tool box icon in the menu bar, select Firefox or Chrome. Start the job. From there you can use the browser to log into a cloud storage account and transfer you files.

Transfer very large files using Global File Transfer (GFT)

For large files see Global File Transfer

PeaZip – Compressing and Zipping Files using PeaZip tool

PeaZip is a graphical interface to 7zip. It is recommended to compress files into an archive before downloading. Compressing folders into single files could improve transfer performance.

PeaZIP is available to create and manage archives. For best performance please use a compute node to compress/decompress large archives. PeaZip can take advantage of multi-cores to speed file compression. The more cores, the faster the compression (in most cases).

  1. Start a Remote Graphics session.
  2. Select “PeaZip” from the Sabalcore launcher menu.
  3. The default node specification is fine for general archiving and compression. Adjust the number of cores based on your workload.
  4. If this is your first time using PeaZip, select the “Home” bookmark on the left to jump to your home directory.
  5. Find the folder(s) you wish to zip and select it.
  6. Select “Add” from the menu bar at the top.
  7. Under output, we recommend “ZIP”, “Fastest, Fast, or Normal”, and “Single volume”. There is usually not much benefit in using very high compression because the time it takes to compress the file can be used to transfer it instead.
  8. Click “OK”.
  9. When finished, be sure to exit the interactive job. Peazip will not exit the job when it’s finished. You must manually exit the job.

p7Zip – Compressing and Zipping Files using 7zip

7zip is command line only. Here are some common examples. We recommend contacting Sabalcore Support if your a unfamiliar. Support will create a zip.pbs template that you can easily modify for your needs.

First, start an interactive job with 6 or more cores. 7zip will utilize all the cores. Using more cores may speed up the compression. Load the 7zip module “module load p7zip”.

To compress a folder:

7za a my_archive.7z my_folder

Install 7zip on your PC. Use it to extract the archive.

You can use the “&& exit” option to automatically exit the interactive job when the zip command completes. For example:

7za a my_archive.7z my_folder && exit

 

Linux

Files can be transferred by command line using standard secure copy (scp). You can also download using ftp or wget.

Examples
▪ Copy a file from your workstation to your Sabalcore account to a directory called “files”.

[user@sci01 ~]$ scp file your_username@login.sabalcore.com:files/

▪ Download a file from the web using wget. This can be executed on the login server or a compute node.

[user@sci01 ~]$ wget http://somewebsite.com/files/file.name

Other Secure Copy Clients

Users can also use any third party client that supports scp file transfer.

Expand Drive

Use ExpanDrive to add your Sabalcore account to Windows Explorer as a mounted drive. Easily drag and drop files. This is a pay app but it very versatile.

  1. Install the application.
  2. Select New Connection from the “ExpandDrive” drop down.
  3. Select “SSH (SFTP)”
  4. Use “scicluster.com” as the server. Enter your sabalcore user ID and password
  5. Enter Nickname “sabalcore”
  6. Select a drive letter (any)
  7. Click “Automatically Mount as Drive”. Your Sabalcore account will represented as a drive on your PC.

Other transfer clients such as FileZilla

  1. Install FileZilla.
  2. Go to Edit -> Settings.
  3. Use SCP or SFTP protocol
  4. Use “login.sabalcore.com” as the server. Enter your sabalcore user ID and password
  5. Select Transfers in the left pane. Set the “Maximum simultaneous transfers” to 4 or 6.
  6. FileZilla has resume transfer capability in the event the connection is interrupted. Select Transfer -> Process Queue. Select “Resume” in the pop-up window.

 

 

Tagged: