Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Problems while running WACCM with openmpi

shujch03@lzu_cn

New Member
Hi,everyone.I run WACCM well using mpich, but have problems while using openmpi.

I configure the model as:
./models/atm/cam/bld/configure -chem waccm_mozart -dyn fv -cam_exe waccm -res 4x5 -mpi_inc /public1/software/mpi/openmpi132-pgi/include -mpi_lib /public1/software/mpi/openmpi132-pgi/lib -nc_inc /home/student/lzutianws1/tools/netcdf/include -nc_lib /home/student/lzutianws1/tools/netcdf/lib -spmd -test

It shows the following errors :
Looking for a valid GNU make... using gmake
Testing for Fortran 90 compatible compiler... using pgf95
Testing NetCDF library... ok
Testing MPI library... **** FAILED ****
Issued the command:
gmake test_mpi 2>&1
The output was:
cat: Srcfiles: No such file or directory
Makefile:1121: /home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/Depends: No such file or directory
gmake: Warning: File `Makefile' has modification time 9.7e+02 s in the future
/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/bld/mkSrcfiles > /home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/Srcfiles
/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/bld/mkDepends Filepath Srcfiles > /home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/Depends
gmake: Warning: File `/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/Depends' has modification time 9.8e+02 s in the future
pgf95 -c -I. -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/chemistry/waccm_mozart -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/physics/waccm -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/physics/cam1 -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/dynamics/fv -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/control -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/csm_share/shr -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/utils -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/utils/timing -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/utils/pilgrim -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/atm/cam/src/ocnsice/dom -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/lnd/clm2/src/main -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/lnd/clm2/src/biogeophys -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/lnd/clm2/src/biogeochem -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/lnd/clm2/src/mksrfdata -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/lnd/clm2/src/riverroute -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/models/ice/csim4 -I/home/student/lzutianws1/tools/netcdf/include -I/public1/software/mpi/openmpi132-pgi/include -I/home/student/lzutianws1/wangwk/openmpi/cam3_1_9_brnchT_waccm_14/esmf/mod/modO/linux_pgi -I/home/student/lzutianws1/tools/netcdf/lib -r8 -i4 -DCAM -DNO_SHR_VMATH -DHIDE_SHR_MSG -DWACCM_MOZART -DLINUX -Mdalign -Mextend -DNO_R16 -byteswapio -O1 test_mpi.F
pgf95 -o test_mpi test_mpi.o -L/public1/software/mpi/openmpi132-pgi/lib -lmpi
test_mpi.o: In function `MAIN_':
test_mpi.F:(.text+0x19): undefined reference to `mpi_init_'
gmake: *** [test_mpi] Error 2

the libraries of my openmpi are:
libmca_common_sm.la libmpi_cxx.so.0.0.0 libmpi_f90.so.0 libopenmpi_malloc.so libopen-rte.la libvt.fmpi.a
libmca_common_sm.so libmpi_f77.la libmpi_f90.so.0.0.0 libopenmpi_malloc.so.0 libopen-rte.so libvt.mpi.a
libmca_common_sm.so.0 libmpi_f77.so libmpi.la libopenmpi_malloc.so.0.0.0 libopen-rte.so.0 libvt.omp.a
libmca_common_sm.so.0.0.0 libmpi_f77.so.0 libmpi.so libopen-pal.la libopen-rte.so.0.0.0 libvt.ompi.a
libmpi_cxx.la libmpi_f77.so.0.0.0 libmpi.so.0 libopen-pal.so libotf.a mpi.mod
libmpi_cxx.so libmpi_f90.la libmpi.so.0.0.0 libopen-pal.so.0 libotf.la openmpi
libmpi_cxx.so.0 libmpi_f90.so libopenmpi_malloc.la libopen-pal.so.0.0.0 libvt.a

Are there anybody can help me run WACCM with openmpi correct?

Thanks a lot!
 
I have heard of one other user who ran into difficulty running WACCM on a cluster which has OpenMPI rather than MPICH. I have not heard of anyone succeeding in this task.

The first step in porting WACCM to a new system is to see if you can get CAM to build and run there. Have you tried that yet? If you run into difficulty there, please post to the CAM forum. Once you have succeeded in running CAM, we can help you with WACCM issues here.
 
Top