Table of Contents
| Linux Cluster |
The new Linux cluster, LC, from Dell Computers
is now available for general use.
This is a cluster of 100 Pentium processors (2.66GHz)
with 1 Gbyte of memory on each processor.
The LC can be used to run single processor jobs and
parallel jobs which do not require the high performance network of the SC.
This will free up the SC to focus on tasks which require its special features
such as large memory and the high speed network.
Project accounting is spread across both machines, so total time used is the sum of the time used on both machines. The user environment is much the same on both systems. The batch queues are similar and much of the applications software on the SC will eventually be installed on the LC. The main differences between the two systems are different compilers and in the amount of memory available. Large memory users will need to continue using the SC. There is a web-based user guide ready to use. Much of this guide is common to both the SC and the LC but there is separate information for compilers and running parallel jobs. Similar application software to that on the SC is being installed on the LC. Further information on particular software packages is on-line at http://nf.apac.edu.au/facilities/sc/software/. Note that some packages are still not installed on the LC. These are marked as lc- and their number should decrease as the installation process progresses. The LC cluster has the publicly available LAM MPI library installed so users can run parallel MPI jobs. Although the MPI latency and bandwidth on the cluster are not comparable with the SC, for parallel jobs which do occasional communication, the cluster provides a suitable environment. In particular, users with parallel ensemble tasks are encouraged to investigate the performance of their codes on the LC. Users with single processor code with relatively small memory requirements should also consider using the LC. You can log on to the LC with the same password as you have on the SC. Then you will have to transfer any files you wish to use using ftp and scp. Alternatively the command fastrcp can be used from the SC. This locally written command is similar to rcp, see man fastrcp on both the SC and the LC. The file systems /home and /short have the same features as on the SC and the batch queuing system appears identical. Help is available from help@nf.apac.edu.au if you encounter any problems in porting code between the two systems. |
| GS1280 16CPU SMP |
The APAC National Facility has recently taken delivery of a 16 CPU,
SMP HP GS1280, the Marvel. The processors are alpha ev7, there is 16 GB of
Rambus (shared) memory and
210 GB of jobfs scratch space. This will allow the running of larger
OpenMP jobs. The GS1280 will share file systems and batch queues with the SC.
To access the GS1280 via the batch queues on the SC use the qsub option -lncpus=N:N where N<=16. If you require 4 or fewer processors also use -lother=bigsmp to ensure that your job is placed on the GS rather than the SC. Some single processor jobs submitted to the SC queues may be placed on the GS by the scheduler. If you want to be sure that your job will not be run on the GS (for example, if you use the /fast file system) include the option -lother=not_bigsmp to qsub. Note that SC MPI is not available on the GS so MPI jobs compiled on the SC will not run on the GS. |
| Call for proposals for acquisition of software |
Users are reminded that they can request third party software for
installation on the SC
and LC at any time by filling in a software request form at
http://nf.apac.edu.au/accounts/forms/software.php In some cases (for example if the licence cost is particularly high and the number of prospective users is small), the user may be asked to contribute to the cost of the licence. When making the request it helps to give as much information as possible about the software, including cost, where it is available and site for downloading if it is free software. |
| Notes on using licensed software |
With the addition of the LC cluster it may be necessary to review the
number of licences available for some software. For example, it seems
that we may need to provide more licences for MATLAB. Users should be
aware that the licence server is common to both machines so there is
nothing to be gained by shifting from one machine to the other in an
attempt to access free licences.
Users are also reminded to use the -lsoftware flag when submitting batch jobs that require access to licensed software. This ensures that a batch job does not start if there are no free licences. In fact, the licence checking process now requires this flag before providing a licence. |
| Monitoring jobs | A graphical tool for viewing the status of your jobs in the queues of either the SC or the LC can be viewed at http://nf.apac.edu.au/facilities under the heading Current Job Details, Layout and Usage Displays. This now includes details on time of job submission and memory and jobfs being used so users can monitor the progress of their batch jobs. |