HPCx

More Information at HPCx

Address

Shell

ksh. But we are using bash. So after log-in, you shoud type "bash".

Set up environment

Not needed

Compiling option

The easiest way is to use makefile. The name of makefile is Makefile.OMP.f.

After writing up a makefile, you just type "make -f Makefile.OMP.f" to compile your code.

Example of makefile

MF= Makefile.OMP.f

FC= xlf_r
FFLAGS= -q64 -O3 -qarch=pwr4 -qtune=pwr4 -qsmp=omp,noauto -qrealsize=8 -lessl
LFLAGS= $(FFLAGS)

EXE= main

SRC= \
main.f setup.f mesh.f indices.f iniup.f readup.f \
writeup.f getup.f bcond.f uhcalc.f dpcalc.f \
upcalc.f sgs.f filter.f nutcheck.f strain.f \
rhs1.f rhs2.f rhs3.f rhsdp.f getuh1.f \
getuh2.f getuh3.f tdmai.f ctdma1j.f ctdma3i.f \
divcheck.f cfl.f iniwave.f metricpoisson.f \
getdp.f takedp.f tdmap.f chkmf.f \
profile.f sgstress.f insfield.f energy.f wallss.f \
writeavg.f openmpcut.f fftsg.f fftsg2d.f \
identi.f omega.f

#
# No need to edit below this line
#

.SUFFIXES: .f .o

OBJ= $(SRC:.f=.o)

.f.o:
$(FC) $(FFLAGS) -c $<

all: $(EXE)

$(EXE): $(OBJ)
$(FC) $(LFLAGS) -o $@ $(OBJ)

$(OBJ): $(MF)

tar:
tar cvf $(EXE).tar $(MF) $(SRC)

clean:
rm -f $(OBJ) $(EXE) core

Job submission

You should submit using loadleveler.

Example of script file by hand (myprog.ll)

#@ shell = /bin/bash
#
#@ job_name = myprog
#
#@ job_type = parallel
#@ cpus = 1
#@ node_usage = not_shared
#
#@ wall_clock_limit = 06:00:00
#@ account_no = e01-wp1
#
#@ resources= ConsumableCpus(16) ConsumableMemory(20gb)
#@ error= $(job_name).$(schedd_host).$(jobid).err
#@ output= $(job_name).$(schedd_host).$(jobid).out
#@ notify_user = Y.M.Chung@warwick.ac.uk
#@ notification = complete
#
#@ queue
#
export XLSMPOPTS="parthds=16:spins=0:yields=0"

./main > result

--------------------------------------------------

llsubmit: submit your job ex) llsubmit *.ll

llq: show status of your job

If you want to see your jobs only, you type "llq -u username".

llcancel: delete your job ex) llcancel jobid