Migration to the new cluster
Filestore
User filestore (home and storage) was initially syncronised at the begining of July. The easiest way to ensure that filestore on the new system is in sync with filestore on the old system is to use rsync. For your home directory, type the following on the original HPC's frontend:
rsync -av /home/hpc/xy/username/ corona.hpc.lancs.ac.uk:/home/hpc/xy/username
And for your storage filestore:
rsync -av /storage/hpc/xy/username/ corona.hpc.lancs.ac.uk:/storage/hpc/xy/username
Where xy is the bin number of your account, and username is your username.
Please Note: The trailing slash on the first argument is important.
Synchronisation can be a slow process; if you wish to transfer only a small set of files across to the new cluster, you may wish to use scp instead.
Changes
There are a number of small changes in the way the new system works. Here's a list of things to bear in mind:
- Binaries: The new system is not binary compatible with the old. You will need to recompile your applications from source.
- Modules: Many applications and packages are now accessed via modules
- User quotas: User quotas can be viewed using the command panquota
- fs.hpc: The deprecated "fs.hpc" in pathnames (e.g. "/home/fs.hpc") has now been discontinued - use "hpc" instead.
- Job scripts: The old style environment setup (e.g. setting the relevant PATH and LD_LIBRARY_PATH) has been replaced with the single command line ". /etc/profile", followed by loading any relevant modules.
- Task arrays: SGE's $COD_TASK_ID variable has been replaced
with $SGE_TASK_ID
©Lancaster University Computer User Agreement Privacy Statement
©Lancaster University ISS Governance Computer User Agreement Privacy & Cookies Notice
Lancaster UniversityBailriggLancasterLA1 4YW United Kingdom+44 (0) 1524 65201