{"id":353,"date":"2020-02-25T11:11:45","date_gmt":"2020-02-25T16:11:45","guid":{"rendered":"http:\/\/localhost:8080\/?p=353"},"modified":"2024-05-21T11:30:18","modified_gmt":"2024-05-21T15:30:18","slug":"transferring-files","status":"publish","type":"post","link":"https:\/\/knowledgebasev.kinsta.cloud\/?p=353","title":{"rendered":"6) Transferring Files"},"content":{"rendered":"<p>Files can be transferred to\/from your Sabalcore account in several ways.<\/p>\n<p>In this article you will find information for:<\/p>\n<ul>\n<li>Simple transfer using SFTP<\/li>\n<li>Using\u00a0a browser<\/li>\n<li><a href=\"\/?p=1689\">Large file transfer using Global File Transfer <\/a>(GFT)<span style=\"color: #ff0000;\"><em>\u00a0<\/em><\/span><\/li>\n<li>Zipping and compressing files before transfer using PeaZip or 7zip<\/li>\n<li>Other file transfer clients &#8211;\u00a0ExpanDrive and Filezilla<\/li>\n<\/ul>\n<h4>Transfer using\u00a0\u00a0SFTP<\/h4>\n<p>To transfer a file simply select \u201cTools &#8211;&gt; SFTP\u00a0File Transfers&#8230;&#8221; from the Sabalcore ssClient drop down menu.<\/p>\n<p>Your local PC is represented in the left pane, your Sabalcore account in the right pane. Select your files and folders and issue the transfer using the buttons between the two panes.\u00a0For large files, use GFT.<\/p>\n<h4>Transfer using\u00a0\u00a0a browser<\/h4>\n<p>Start or open a Sabalcore Remote Desktop (Tools &#8211;&gt; Remote Desktop). From the tool box icon in the menu bar, select Firefox or Chrome. Start the job. From there you can use the browser to log into a cloud storage account and transfer you files.<\/p>\n<h4>Transfer very large files using Global File Transfer (GFT)<\/h4>\n<p>For large files see\u00a0<a href=\"\/?p=1689\">Global File Transfer<\/a><\/p>\n<h4><\/h4>\n<h4>PeaZip &#8211; Compressing and Zipping Files using PeaZip tool<\/h4>\n<p>PeaZip is a graphical interface to 7zip. It is recommended to compress files into an archive before downloading. Compressing folders into single files could improve transfer performance.<\/p>\n<p>PeaZIP is available to create and manage archives. For best performance please use a compute node to compress\/decompress large archives. PeaZip can take advantage of multi-cores to speed file compression. The more cores, the faster the compression (in most cases).<\/p>\n<ol>\n<li>Start a Remote Graphics session.<\/li>\n<li>Select &#8220;PeaZip&#8221; from the Sabalcore launcher menu.<\/li>\n<li>The default node specification is fine for general archiving and compression. Adjust the number of cores based on your workload.<\/li>\n<li>If this is your first time using PeaZip, select the &#8220;Home&#8221; bookmark on the left to jump to your home directory.<\/li>\n<li>Find the folder(s) you wish to zip and select it.<\/li>\n<li>Select &#8220;Add&#8221; from the menu bar at the top.<\/li>\n<li>Under output, we recommend &#8220;ZIP&#8221;, &#8220;Fastest, Fast, or Normal&#8221;, and &#8220;Single volume&#8221;. There is usually not much benefit in using very high compression because the time it takes to compress the file can be used to transfer it instead.<\/li>\n<li>Click &#8220;OK&#8221;.<\/li>\n<li>When finished, be sure to\u00a0exit the interactive job. Peazip will not exit the job when it&#8217;s finished. <span style=\"text-decoration: underline;\">You must manually exit the job<\/span>.<\/li>\n<\/ol>\n<h5><\/h5>\n<h4>p7Zip &#8211; Compressing and Zipping Files using 7zip<\/h4>\n<p>7zip is command line only. Here are some common examples. We recommend contacting Sabalcore Support if your a unfamiliar. Support will create a zip.pbs template that you can easily modify for your needs.<\/p>\n<p>First, start an <a href=\"\/?p=223\">interactive job<\/a> with 6 or more cores. 7zip will utilize all the cores. Using more cores may speed up the compression. Load the 7zip module &#8220;module load p7zip&#8221;.<\/p>\n<p>To compress a folder:<\/p>\n<pre>7za a my_archive.7z my_folder<\/pre>\n<p>Install <a href=\"http:\/\/www.7-zip.org\/download.html\" target=\"_blank\">7zip on your PC<\/a>. Use it to extract the archive.<\/p>\n<p>You can use the &#8220;&amp;&amp; exit&#8221; option to automatically exit the interactive job when the zip command completes. For example:<\/p>\n<pre>7za a my_archive.7z my_folder &amp;&amp; exit<\/pre>\n<p>&nbsp;<\/p>\n<h4><\/h4>\n<h4>Linux<\/h4>\n<p>Files can be transferred by command line using\u00a0standard secure copy (scp). You can also download using ftp or wget.<\/p>\n<p>Examples<br \/>\n\u25aa Copy a file from your workstation to your Sabalcore account to a directory called &#8220;files&#8221;.<\/p>\n<pre>[user@sci01 ~]$ scp file your_username@login.sabalcore.com:files\/<\/pre>\n<p>\u25aa Download a file from the web using wget. This can be executed on the login server or\u00a0a compute node.<\/p>\n<pre>[user@sci01 ~]$ wget http:\/\/somewebsite.com\/files\/file.name<\/pre>\n<h4><\/h4>\n<h4>Other Secure Copy Clients<\/h4>\n<p>Users can also use any third party client that supports scp file transfer.<\/p>\n<p><strong>Expand Drive<\/strong><\/p>\n<p>Use <a href=\"https:\/\/www.expandrive.com\/\" target=\"_blank\">ExpanDrive<\/a> to add your Sabalcore account to Windows Explorer as a mounted drive. Easily drag and drop files.\u00a0This is a pay app but it very versatile.<\/p>\n<ol>\n<li>Install the application.<\/li>\n<li>Select New Connection from the &#8220;ExpandDrive&#8221; drop down.<\/li>\n<li>Select &#8220;SSH (SFTP)&#8221;<\/li>\n<li>Use &#8220;scicluster.com&#8221; as the server. Enter your sabalcore user ID and password<\/li>\n<li>Enter Nickname &#8220;sabalcore&#8221;<\/li>\n<li>Select a drive letter (any)<\/li>\n<li>Click &#8220;Automatically Mount as Drive&#8221;. Your Sabalcore account will represented as a drive on your PC.<\/li>\n<\/ol>\n<p><strong>Other transfer clients such as FileZilla<\/strong><\/p>\n<ol>\n<li>Install <a title=\"FileZilla free sftp client.\" href=\"https:\/\/filezilla-project.org\/\" target=\"_blank\">FileZilla<\/a>.<\/li>\n<li>Go to Edit -&gt; Settings.<\/li>\n<li>Use SCP or SFTP protocol<\/li>\n<li>Use &#8220;login.sabalcore.com&#8221; as the server. Enter your sabalcore user ID and password<\/li>\n<li>Select Transfers in the left pane. Set the &#8220;Maximum simultaneous transfers&#8221; to 4 or 6.<\/li>\n<li>FileZilla has resume transfer capability in the event the connection is interrupted. Select Transfer -&gt; Process Queue. Select &#8220;Resume&#8221; in the pop-up window.<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Files can be transferred to\/from your Sabalcore account in several ways. In this article you will find information for: Simple transfer using SFTP Using\u00a0a browser Large file transfer using Global File Transfer (GFT)\u00a0 Zipping and compressing files before transfer using PeaZip or 7zip Other file transfer clients &#8211;\u00a0ExpanDrive and Filezilla Transfer using\u00a0\u00a0SFTP To transfer a [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[82,83,84],"class_list":["post-353","post","type-post","status-publish","format-standard","hentry","category-userguidebasics","tag-file-transfer","tag-scp","tag-sftp"],"_links":{"self":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts\/353","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=353"}],"version-history":[{"count":74,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts\/353\/revisions"}],"predecessor-version":[{"id":2028,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=\/wp\/v2\/posts\/353\/revisions\/2028"}],"wp:attachment":[{"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=353"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=353"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/knowledgebasev.kinsta.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=353"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}