NFS: /scratch vs /local

NFS = network file system. allspice is our main file server, but we also use beet for snapshots and mango for /scratch.

Each lab machine has it's own /local partition. /scratch is really on mango, but mounted over the network to each lab machine. /scratch should look the same from any lab machine (just like your home dir).

If you have a long-running job that writes lots of data, try to write that data to a /local. It will be *much* faster than writing to /scratch.

/scratch and the /locals do not get backed up, so don't store any critical files on those partitions.


wasabi[~]$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1             8.9G  3.2G  5.4G  37% /
none                  7.9G  284K  7.9G   1% /dev
none                  7.9G     0  7.9G   0% /dev/shm
none                  7.9G   88K  7.9G   1% /var/run
none                  7.9G     0  7.9G   0% /var/lock
/dev/sda6            1004M   18M  987M   2% /tmp
/dev/sda7              12G  8.2G  3.1G  74% /usr
/dev/sda8             894G   59G  826G   7% /local
allspice.cs.swarthmore.edu:/usr/local
                       50G   18G   30G  38% /usr/local
allspice.cs.swarthmore.edu:/usr/swat
                      9.9G  2.5G  6.9G  27% /usr/swat
allspice.cs.swarthmore.edu:/var/mail
                       20G  1.5G   18G   8% /var/mail
beet.cs.swarthmore.edu:/root/snapshots
                      917G  393G  478G  46% /snapshots
mango.cs.swarthmore.edu:/data
                      338G  110G  211G  35% /data
allspice:/export/home/users2/ru1
                      255G   27G  215G  11% /home/ru1



Every user has their own /scratch directory.


mace[~]$ pwd
/home/ru1

mace[~]$ cd /scratch/ru1
mace[ru1]$ pwd
/scratch/ru1

	

Users can create a directory on any /local. Each /local is different. /local on mace is smaller than /local on wasabi.


MACE[~]$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1             8.9G  3.5G  5.0G  42% /
none                  3.9G  224K  3.9G   1% /dev
none                  4.0G     0  4.0G   0% /dev/shm
none                  4.0G  100K  4.0G   1% /var/run
none                  4.0G     0  4.0G   0% /var/lock
/dev/sda6            1004M   18M  987M   2% /tmp
/dev/sda8             206G  197M  204G   1% /local
/dev/sda7              12G  8.2G  3.1G  74% /usr
allspice.cs.swarthmore.edu:/usr/local
                       50G   18G   30G  38% /usr/local
allspice.cs.swarthmore.edu:/usr/swat
                      9.9G  2.5G  6.9G  27% /usr/swat
allspice.cs.swarthmore.edu:/var/mail
                       20G  1.5G   18G   8% /var/mail
beet.cs.swarthmore.edu:/root/snapshots
                      917G  393G  478G  46% /snapshots
mango.cs.swarthmore.edu:/data
                      338G  110G  211G  35% /data
allspice:/export/home/staff/knerr
                      275G   44G  217G  17% /home/knerr



mace[~]$ cd /local
mace[local]$ mkdir mynewdirectory
mace[local]$ cd mynewdirectory/
mace[mynewdirectory]$ pwd
/local/mynewdirectory

mace[mynewdirectory]$ ls -al
total 8
drwx------ 2 ru1  users 4096 Jun 13 09:04 ./
drwxrwxrwt 7 root root  4096 Jun 13 09:04 ../
mace[mynewdirectory]$