SCP Servers help you transfer files to and from servers, computers and other networking devices using a secure-tunnel via SSH. Secure Copy, or SC in short, is a network protocol that supports file transfers between hosts on the same network. It is based on the BSD RCP protocol and uses a secure shell (SSH) to transfer data. MKVtoolnix is a set of tools to create, alter, and inspect Matroska files under OS X, Linux and other Unices, and Windows. They do for Matroska what the OGMtools do for the OGM format and then some. Since May 1st 2003, the Matroska libraries themselves and my Matroska tools are officially released as a first public beta version.
Updated 2020-12-30
Overview¶
- You can send files to whatever dir you want on the cluster, (home / personal dirs in home, scratch, or data) altough some directories might be better than others for certain files.
- Ex: if you want to upload a very large data set that you only want to use for a couple computations, upload it to
/scratch
- This guide uses the secure tool
scp
which stands for Secure Copy. Its easy to use, safe, and reliable, and is run in the terminal. However, it will be noticeably slower than globus if transfering large files
From Local Computer to Cluster (Onto Cluster)¶
- Say I wanted to send a PBS script, a python file, and data set in the form of a .csv file to the cluster.
- Im going to send them to scratch, since I plan on running the python file on the data set only a couple times, gathering the results, and then deleting the files off scratch (I don't plan on using them anymore)
- The first step is to make sure you are in the directory of the files you want to send
- The template to send files from a local machine to a remote host is:
From Cluster to Personal Computer (Off of Cluster)¶
- Lets say a job had just finished running, and had created a log file with its results.
- To move those result files off of the cluster to your computer, you can use scp.
- For this scenario I will be moving
weather.csv
, a csv file that contains the results of a python program I have run on the cluster, to my personal laptop. - The template to send files from the cluster to a local machine is this:
Scp Gui Tool For Mac Os
Moving Directories¶
Scp Gui Tool For Mac Installer
Scp Gui Tool For Mac Windows 10
- To move a directory, simply use the
-r
flag which tells scp to copy the directory and anything contained in it recursively - Copying
/scripts
dir From Remote (cluster) to/PACE-GT
on local machine (laptop):