vineetm@cdac_in
Member
Hi,I have compiled the application successfully but getting errors while running the application.PLEASE REFER THE ATTACHMENT FOR THE SAME FORMATTED MAIL FOR BETTER VISUALIZATION (Was not able to format this correctly)-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Here are the configurations I have used for building the application:1) gcc-7.2.0 binutils-2.31 coreutils-8.30 perl-5.10.12) pgi-18.43) zlib-1.2.114) mpich-3.2.15) curl-7.61.16) szip-2.1.17) hdf5-1.10.4 (parallel build)8) parallel-netcdf-1.10.09) netcdf-4.6.110) netcdf-fortran-4.4.4-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Note: In CESM code, I have performed the following changes:1) Updated pio SVN repo linkIn the top level SVN_EXTERNAL_DIRECTORIES change:-models/utils/pio http://parallelio.googlecode.com/svn/trunk_tags/pio1_8_12/pio+models/utils/pio https://github.com/NCAR/ParallelIO.git/tags/pio1_8_12/pioIn the tools/cprnc/SVN_EXTERNAL_DIRECTORIES change:-genf90 http://parallelio.googlecode.com/svn/genf90/trunk_tags/genf90_140121+genf90 https://github.com/PARALLELIO/genf90/tags/genf90_140121 After each change run:svn propset svn:externals -F SVN_EXTERNAL_DIRECTORIES .svn update 2) Patched FindNETCDF.cmake (Reference: https://bb.cgd.ucar.edu/sites/default/files/vbtodrupal/find_netcdf_patch_0.txt)3) Change all the references of variables with dimension "PIO_MAX_VAR_DIMS" from static to dynamic allocation.This was done since the variables with dimension "PIO_MAX_VAR_DIMS" produced error with static allocation. (Without the change I had to use -mcmodel=medium flag which i didn't want)#Following are the list of files:cesm1_2_2_CAMChem/models/utils/pio/piodarray.F90cesm1_2_2_CAMChem/models/utils/pio/piodarray.F90.incesm1_2_2_CAMChem/models/utils/pio/pionfwrite_mod.F90cesm1_2_2_CAMChem/models/utils/pio/pio_types.F90cesm1_2_2_CAMChem/models/utils/pio/pionfget_mod.F90.incesm1_2_2_CAMChem/models/utils/pio/pionfget_mod.F90cesm1_2_2_CAMChem/models/utils/pio/pionfread_mod.F90.incesm1_2_2_CAMChem/models/utils/pio/pionfread_mod.F90cesm1_2_2_CAMChem/models/utils/pio/pionfwrite_mod.F90.incesm1_2_2_CAMChem/models/utils/pio/pio_msg_callbacks.F90cesm1_2_2_CAMChem/models/atm/cam/src/physics/cam/radae.F90cesm1_2_2_CAMChem/models/atm/cam/src/utils/cam_dom/ocn_comp.F90 cesm1_2_2_CAMChem/models/atm/cam/src/control/ncdio_atm.F90-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Following is the Macros file:
## Makefile Macros generated from /scratch/vineetm/CESM/shared/cesm1_2_2_CAMChem/scripts/ccsm_utils/Machines/config_compilers.xml using# COMPILER=pgi# OS=LINUX# MACH=userdefined#CPPDEFS+= -DFORTRANUNDERSCORE -DNO_SHR_VMATH -DNO_R16 -DLINUX -DCPRPGISLIBS+=-L/scratch/vineetm/CESM/shared/deps/lib -lnetcdff -lnetcdf -lpnetcdf -lhdf5_hl -lhdf5 -lhdf5hl_fortran -lhdf5_fortran -lcurl -lsz -lz# USERDEFINED $(shell $(NETCDF_PATH)/bin/nc-config --flibs)CFLAGS:= -O0 -gopt -Mlist -time -fPIC -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64CONFIG_ARGS:=CXX_LINKER:=CXXESMF_LIBDIR:=FC_AUTO_R8:= -r8FFLAGS:= -O0 -i4 -gopt -Mlist -time -Mextend -byteswapio -Mflushz -Kieee -fPIC -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64FIXEDFLAGS:= -MfixedFREEFLAGS:= -MfreeLDFLAGS:= -time -Wl,--allow-multiple-definitionMPICC:= mpiccMPICXX:= mpicxxMPIFC:= mpifortMPI_LIB_NAME:=MPI_PATH:=/scratch/vineetm/CESM/shared/depsNETCDF_PATH:=/scratch/vineetm/CESM/shared/depsPNETCDF_PATH:=/scratch/vineetm/CESM/shared/depsSCC:= pgccSCXX:= pgc++SFC:= pgf95SUPPORTS_CXX:=FALSEifeq ($(DEBUG), TRUE) FFLAGS += -O0 -g -Ktrap=fp -Mbounds -Kieeeendififeq ($(compile_threaded), false) LDFLAGS += -nomp CFLAGS += -nomp FFLAGS += -nompendififeq ($(compile_threaded), true) LDFLAGS += -mp CFLAGS += -mp FFLAGS += -mpendififeq ($(MODEL), dwav) FFLAGS += -Mnovectendififeq ($(MODEL), dlnd) FFLAGS += -Mnovectendififeq ($(MODEL), drof) FFLAGS += -Mnovectendififeq ($(MODEL), pop2) CPPDEFS += -D_USE_FLOW_CONTROLendififeq ($(MODEL), dice) FFLAGS += -Mnovectendififeq ($(MODEL), docn) FFLAGS += -Mnovectendififeq ($(MODEL), datm) FFLAGS += -Mnovectendif-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Following is the env_mach_specific file:
#! /bin/csh -f # -------------------------------------------------------------------------# USERDEFINED# Edit this file to add module load or other paths needed for the build# and run on the system. Can also include general env settings for machine.# Some samples are below# ------------------------------------------------------------------------- #source /opt/modules/default/init/csh#if ( $COMPILER == "pgi" ) then# module load pgi#endif#module load netcdf limit coredumpsize unlimitedlimit stacksize unlimitedsetenv CESM_PREFIX /scratch/vineetm/CESM/shared #GNUsetenv PATH $CESM_PREFIX/gnu/bin:$PATHsetenv LD_LIBRARY_PATH $CESM_PREFIX/gnu/lib:$CESM_PREFIX/gnu/lib64:$LD_LIBRARY_PATHsetenv LD_RUN_PATH $CESM_PREFIX/gnu/lib:$CESM_PREFIX/gnu/lib64setenv MANPATH $CESM_PREFIX/gnu/share/man:$MANPATH #PGI environmentsetenv pgihome $CESM_PREFIX/pgisetenv pgidir $pgihome/linux86-64/18.4setenv PGI $pgihomesetenv CC $pgidir/bin/pgccsetenv FC $pgidir/bin/pgfortransetenv F90 $pgidir/bin/pgf90setenv F77 $pgidir/bin/pgf77setenv CPP "$pgidir/bin/pgcc -Mcpp"setenv CXX $pgidir/bin/pgc++setenv PATH $pgidir/bin:$PATHsetenv MANPATH $pgidir/man:$MANPATHsetenv LD_LIBRARY_PATH $pgidir/lib:$LD_LIBRARY_PATH #PGI openmpi environmentsetenv pgilibdir $pgihome/linux86-64/2018/mpi/openmpi-2.1.2setenv PGI_OPTL_LIB_DIRS "$pgilibdir/lib"setenv PGI_OPTL_INCLUDE_DIRS "$pgilibdir/include"setenv PATH $pgilibdir/bin:$PATHsetenv MANPATH $pgilibdir/share/man:$MANPATHsetenv LD_LIBRARY_PATH $pgilibdir/lib:$LD_LIBRARY_PATH #DEPSsetenv HDF5_ROOT $CESM_PREFIX/depssetenv PATH $CESM_PREFIX/deps/bin:$PATHsetenv LD_LIBRARY_PATH $CESM_PREFIX/deps/lib:$LD_LIBRARY_PATHsetenv MANPATH $CESM_PREFIX/deps/share/man:$MANPATHsetenv PKG_CONFIG_PATH $CESM_PREFIX/deps/lib/pkgconfigsetenv LD_RUN_PATH $CESM_PREFIX/deps/lib:$LD_RUN_PATH setenv LANG C-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Following is the case that i am setting up: COMPSET=B_1850_CN RES=0.9x1.25_gx1v6 MACH=userdefined CCSMROOT=/scratch/vineetm/CESM/shared/cesm1_2_2_CAMChem CASE=SCASE0 CASEROOT=/scratch/vineetm/CESM/shared/MYCASES EXEROOT=/scratch/vineetm/CESM/shared/MYCASES/SCASE0/EXEC RUNDIR=/scratch/vineetm/CESM/shared/MYCASES/SCASE0/EXEC/run ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Following is the error that I am getting while running: (seq_comm_setcomm) initialize ID ( 1 GLOBAL ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 2 CPL ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 17 ATM ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 18 CPLATM ) join IDs = 2 17 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 10 CPLALLATMID ) join IDs = 2 3 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 19 LND ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 20 CPLLND ) join IDs = 2 19 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 4 ALLLNDID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 11 CPLALLLNDID ) join IDs = 2 4 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 21 OCN ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 22 CPLOCN ) join IDs = 2 21 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 5 ALLOCNID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 12 CPLALLOCNID ) join IDs = 2 5 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 23 ICE ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 24 CPLICE ) join IDs = 2 23 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 6 ALLICEID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 13 CPLALLICEID ) join IDs = 2 6 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 25 GLC ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 26 CPLGLC ) join IDs = 2 25 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 7 ALLGLCID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 14 CPLALLGLCID ) join IDs = 2 7 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 27 ROF ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 28 CPLROF ) join IDs = 2 27 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 8 ALLROFID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 15 CPLALLROFID ) join IDs = 2 8 ( npes = 128) ( nthreads = 1) seq_comm_setcomm) initialize ID ( 29 WAV ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 30 CPLWAV ) join IDs = 2 29 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 9 ALLWAVID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 16 CPLALLWAVID ) join IDs = 2 9 ( npes = 128) ( nthreads = 1) (seq_comm_printcomms) 1 0 128 1 GLOBAL: (seq_comm_printcomms) 2 0 128 1 CPL: (seq_comm_printcomms) 3 0 128 1 ALLATMID: (seq_comm_printcomms) 4 0 128 1 ALLLNDID: (seq_comm_printcomms) 5 0 128 1 ALLOCNID: (seq_comm_printcomms) 6 0 128 1 ALLICEID: (seq_comm_printcomms) 7 0 128 1 ALLGLCID: (seq_comm_printcomms) 8 0 128 1 ALLROFID: (seq_comm_printcomms) 9 0 128 1 ALLWAVID: (seq_comm_printcomms) 10 0 128 1 CPLALLATMID: (seq_comm_printcomms) 11 0 128 1 CPLALLLNDID: (seq_comm_printcomms) 12 0 128 1 CPLALLOCNID: (seq_comm_printcomms) 13 0 128 1 CPLALLICEID: (seq_comm_printcomms) 14 0 128 1 CPLALLGLCID: (seq_comm_printcomms) 15 0 128 1 CPLALLROFID: (seq_comm_printcomms) 16 0 128 1 CPLALLWAVID: (seq_comm_printcomms) 17 0 128 1 ATM: (seq_comm_printcomms) 18 0 128 1 CPLATM: (seq_comm_printcomms) 19 0 128 1 LND: (seq_comm_printcomms) 20 0 128 1 CPLLND: (seq_comm_printcomms) 21 0 128 1 OCN: (seq_comm_printcomms) 22 0 128 1 CPLOCN: (seq_comm_printcomms) 23 0 128 1 ICE: (seq_comm_printcomms) 24 0 128 1 CPLICE: (seq_comm_printcomms) 25 0 128 1 GLC: (seq_comm_printcomms) 26 0 128 1 CPLGLC: (seq_comm_printcomms) 27 0 128 1 ROF: (seq_comm_printcomms) 28 0 128 1 CPLROF: (seq_comm_printcomms) 29 0 128 1 WAV: (seq_comm_printcomms) 30 0 128 1 CPLWAV: (t_initf) Read in prof_inparm namelist from: drv_in 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.51 8 MB memory alloc in MB is 8.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.02 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1050.15 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.01 seq_flds_mod: read seq_cplflds_inparm namelist from: drv_in 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.79 8 MB memory alloc in MB is 8.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1050.15 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.008 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.04 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1049.63 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.79 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.02 8 MB memory alloc in MB is 8.008 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.04 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1049.63 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.008 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1050.15 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.54 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.54 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.04 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1031.05 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1053.32 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 seq_flds_mod: read seq_cplflds_userspec namelist from: drv_in seq_flds_mod: seq_flds_a2x_states= Sa_z:Sa_u:Sa_v:Sa_tbot:Sa_ptem:Sa_shum:Sa_pbot:Sa_dens:Sa_pslv:Sa_co2prog:Sa_co2diag seq_flds_mod: seq_flds_a2x_fluxes= Faxa_rainc:Faxa_rainl:Faxa_snowc:Faxa_snowl:Faxa_lwdn:Faxa_swndr:Faxa_swvdr:Faxa_swndf:Faxa_swvdf:Faxa_swnet:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphi dry:Faxa_ocphodry:Faxa_ocphiwet:Faxa_dstwet1:Faxa_dstwet2:Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4 seq_flds_mod: seq_flds_x2a_states= Sf_lfrac:Sf_ifrac:Sf_ofrac:Sx_avsdr:Sx_anidr:Sx_avsdf:Sx_anidf:Sx_tref:Sx_qref:So_t:Sx_t:Sl_fv:Sl_ram1:Sl_snowh:Si_snowh:So_ssq:So_re:Sx_u10:So_ustar seq_flds_mod: seq_flds_x2a_fluxes= Faxx_taux:Faxx_tauy:Faxx_lat:Faxx_sen:Faxx_lwup:Faxx_evap:Fall_flxdst1:Fall_flxdst2:Fall_flxdst3:Fall_flxdst4 seq_flds_mod: seq_flds_l2x_states= Sl_avsdr:Sl_anidr:Sl_avsdf:Sl_anidf:Sl_tref:Sl_qref:Sl_t:Sl_fv:Sl_ram1:Sl_snowh:Sl_u10 seq_flds_mod: seq_flds_l2x_fluxes= Fall_swnet:Fall_taux:Fall_tauy:Fall_lat:Fall_sen:Fall_lwup:Fall_evap:Fall_flxdst1:Fall_flxdst2:Fall_flxdst3:Fall_flxdst4:Flrl_rofliq:Flrl_rofice seq_flds_mod: seq_flds_x2l_states= Sa_z:Sa_u:Sa_v:Sa_tbot:Sa_ptem:Sa_shum:Sa_pbot:Slrr_volr:Sa_co2prog:Sa_co2diag seq_flds_mod: seq_flds_x2l_fluxes= Faxa_rainc:Faxa_rainl:Faxa_snowc:Faxa_snowl:Faxa_lwdn:Faxa_swndr:Faxa_swvdr:Faxa_swndf:Faxa_swvdf:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphidry:Faxa_oc phodry:Faxa_ocphiwet:Faxa_dstwet1:Faxa_dstwet2:Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4:Flrr_flood seq_flds_mod: seq_flds_i2x_states= Si_avsdr:Si_anidr:Si_avsdf:Si_anidf:Si_tref:Si_qref:Si_t:Si_snowh:Si_u10:Si_ifrac seq_flds_mod: seq_flds_i2x_fluxes= Faii_swnet:Fioi_swpen:Faii_taux:Fioi_taux:Faii_tauy:Fioi_tauy:Faii_lat:Faii_sen:Faii_lwup:Faii_evap:Fioi_melth:Fioi_meltw:Fioi_salt seq_flds_mod: seq_flds_x2i_states= Sa_z:Sa_u:Sa_v:Sa_tbot:Sa_ptem:Sa_shum:Sa_pbot:Sa_dens:So_t:So_s:So_u:So_v:So_dhdx:So_dhdy seq_flds_mod: seq_flds_x2i_fluxes= Faxa_rain:Faxa_snow:Faxa_lwdn:Faxa_swndr:Faxa_swvdr:Faxa_swndf:Faxa_swvdf:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphidry:Faxa_ocphodry:Faxa_ocphiwet:Fax a_dstwet1:Faxa_dstwet2:Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4:Fioo_q seq_flds_mod: seq_flds_o2x_states= So_t:So_s:So_u:So_v:So_dhdx:So_dhdy:So_bldepth seq_flds_mod: seq_flds_o2x_fluxes= Fioo_q seq_flds_mod: seq_flds_x2o_states= Sa_pslv:So_duu10n:Si_ifrac:Sw_lamult:Sw_ustokes:Sw_vstokes:Sw_hstokes seq_flds_mod: seq_flds_x2o_fluxes= Faxa_rain:Faxa_snow:Faxa_prec:Faxa_lwdn:Foxx_swnet:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphidry:Faxa_ocphodry:Faxa_ocphiwet:Faxa_dstwet1:Faxa_dstwet2: Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4:Foxx_taux:Foxx_tauy:Foxx_lat:Foxx_sen:Foxx_lwup:Foxx_evap:Fioi_melth:Fioi_meltw:Fio i_salt:Forr_roff:Forr_ioff seq_flds_mod: seq_flds_s2x_states= seq_flds_mod: seq_flds_s2x_fluxes= seq_flds_mod: seq_flds_x2s_states= seq_flds_mod: seq_flds_x2s_fluxes= seq_flds_mod: seq_flds_g2x_states= seq_flds_mod: seq_flds_g2x_fluxes= seq_flds_mod: seq_flds_x2g_states= seq_flds_mod: seq_flds_x2g_fluxes= seq_flds_mod: seq_flds_xao_states= So_tref:So_qref:So_ssq:So_re:So_u10:So_duu10n:So_ustar seq_flds_mod: seq_flds_xao_albedo= So_avsdr:So_anidr:So_avsdf:So_anidf seq_flds_mod: seq_flds_r2x_states= Slrr_volr seq_flds_mod: seq_flds_r2x_fluxes= Forr_roff:Forr_ioff:Flrr_flood seq_flds_mod: seq_flds_x2r_states= seq_flds_mod: seq_flds_x2r_fluxes= Flrl_rofliq:Flrl_rofice seq_flds_mod: seq_flds_w2x_states= Sw_lamult:Sw_ustokes:Sw_vstokes:Sw_hstokes seq_flds_mod: seq_flds_w2x_fluxes= seq_flds_mod: seq_flds_x2w_states= Sa_u:Sa_v:Sa_tbot:Si_ifrac:So_t:So_u:So_v:So_bldepth seq_flds_mod: seq_flds_x2w_fluxes= 128 pes participating in computation ----------------------------------- TASK# NAME 0 cn00 1 cn00 2 cn00 3 cn00 4 cn00 5 cn00 6 cn00 7 cn00 8 cn00 9 cn00 10 cn00 11 cn00 12 cn00 13 cn00 14 cn00 15 cn00 16 cn00 17 cn00 18 cn00 19 cn00 20 cn00 21 cn00 22 cn00 23 cn00 24 cn00 25 cn00 26 cn00 27 cn00 28 cn01 29 cn01 30 cn01 31 cn01 32 cn01 33 cn01 34 cn01 35 cn01 36 cn01 37 cn01 38 cn01 39 cn01 40 cn01 41 cn01 42 cn01 43 cn01 44 cn01 45 cn01 46 cn01 47 cn01 48 cn01 49 cn01 50 cn01 51 cn01 52 cn01 53 cn01 54 cn01 55 cn01 56 cn02 57 cn02 58 cn02 59 cn02 60 cn02 61 cn02 62 cn02 63 cn02 64 cn02 65 cn02 66 cn02 67 cn02 68 cn02 69 cn02 70 cn02 71 cn02 72 cn02 73 cn02 74 cn02 75 cn02 76 cn02 77 cn02 78 cn02 79 cn02 80 cn02 81 cn02 82 cn02 83 cn02 84 cn03 85 cn03 86 cn03 87 cn03 88 cn03 89 cn03 90 cn03 91 cn03 92 cn03 93 cn03 94 cn03 95 cn03 96 cn03 97 cn03 98 cn03 99 cn03 100 cn03 101 cn03 102 cn03 103 cn03 104 cn03 105 cn03 106 cn03 107 cn03 108 cn03 109 cn03 110 cn03 111 cn03 112 cn04 113 cn04 114 cn04 115 cn04 116 cn04 117 cn04 118 cn04 119 cn04 120 cn04 121 cn04 122 cn04 123 cn04 124 cn04 125 cn04 126 cn04 127 cn04 Opened existing file b40.1850.track1.1deg.006.cam.i.0863-01-01-00000.nc 65536 Opened existing file /scratch/vineetm/CESM/DATA/atm/cam/topo/USGS-gtopo30_0.9x1.25_remap_c051027.nc 131072 NetCDF: Invalid dimension ID or name =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = PID 78992 RUNNING AT cn00 = EXIT CODE: 9 = CLEANING UP REMAINING PROCESSES = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES =================================================================================== [proxy:0:2@cn02] HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:2@cn02] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:2@cn02] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event [proxy:0:3@cn03] HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:3@cn03] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:3@cn03] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event [proxy:0:4@cn04] HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:4@cn04] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:4@cn04] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event [proxy:0:1@cn01] srun: error: cn03: task 3: Exited with exit code 7 srun: error: cn02: task 2: Exited with exit code 7 srun: error: cn01: task 1: Exited with exit code 7 HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:1@cn01] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:1@cn01] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event srun: error: cn04: task 4: Exited with exit code 7 [mpiexec@cn00] HYDT_bscu_wait_for_completion (tools/bootstrap/utils/bscu_wait.c:76): one of the processes terminated badly; aborting [mpiexec@cn00] HYDT_bsci_wait_for_completion (tools/bootstrap/src/bsci_wait.c:23): launcher returned error waiting for completion [mpiexec@cn00] HYD_pmci_wait_for_completion (pm/pmiserv/pmiserv_pmci.c:218): launcher returned error waiting for completion [mpiexec@cn00] main (ui/mpich/mpiexec.c:340): process manager error waiting for completion Wed Nov 14 16:22:34 IST 2018 -- CSM EXECUTION HAS FINISHED ls: No match. ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- The dependencies have been well tested. Not sure what the problem is. Please let me know what should be the changes required. Thanks,Vineet More
## Makefile Macros generated from /scratch/vineetm/CESM/shared/cesm1_2_2_CAMChem/scripts/ccsm_utils/Machines/config_compilers.xml using# COMPILER=pgi# OS=LINUX# MACH=userdefined#CPPDEFS+= -DFORTRANUNDERSCORE -DNO_SHR_VMATH -DNO_R16 -DLINUX -DCPRPGISLIBS+=-L/scratch/vineetm/CESM/shared/deps/lib -lnetcdff -lnetcdf -lpnetcdf -lhdf5_hl -lhdf5 -lhdf5hl_fortran -lhdf5_fortran -lcurl -lsz -lz# USERDEFINED $(shell $(NETCDF_PATH)/bin/nc-config --flibs)CFLAGS:= -O0 -gopt -Mlist -time -fPIC -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64CONFIG_ARGS:=CXX_LINKER:=CXXESMF_LIBDIR:=FC_AUTO_R8:= -r8FFLAGS:= -O0 -i4 -gopt -Mlist -time -Mextend -byteswapio -Mflushz -Kieee -fPIC -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64FIXEDFLAGS:= -MfixedFREEFLAGS:= -MfreeLDFLAGS:= -time -Wl,--allow-multiple-definitionMPICC:= mpiccMPICXX:= mpicxxMPIFC:= mpifortMPI_LIB_NAME:=MPI_PATH:=/scratch/vineetm/CESM/shared/depsNETCDF_PATH:=/scratch/vineetm/CESM/shared/depsPNETCDF_PATH:=/scratch/vineetm/CESM/shared/depsSCC:= pgccSCXX:= pgc++SFC:= pgf95SUPPORTS_CXX:=FALSEifeq ($(DEBUG), TRUE) FFLAGS += -O0 -g -Ktrap=fp -Mbounds -Kieeeendififeq ($(compile_threaded), false) LDFLAGS += -nomp CFLAGS += -nomp FFLAGS += -nompendififeq ($(compile_threaded), true) LDFLAGS += -mp CFLAGS += -mp FFLAGS += -mpendififeq ($(MODEL), dwav) FFLAGS += -Mnovectendififeq ($(MODEL), dlnd) FFLAGS += -Mnovectendififeq ($(MODEL), drof) FFLAGS += -Mnovectendififeq ($(MODEL), pop2) CPPDEFS += -D_USE_FLOW_CONTROLendififeq ($(MODEL), dice) FFLAGS += -Mnovectendififeq ($(MODEL), docn) FFLAGS += -Mnovectendififeq ($(MODEL), datm) FFLAGS += -Mnovectendif-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Following is the env_mach_specific file:
#! /bin/csh -f # -------------------------------------------------------------------------# USERDEFINED# Edit this file to add module load or other paths needed for the build# and run on the system. Can also include general env settings for machine.# Some samples are below# ------------------------------------------------------------------------- #source /opt/modules/default/init/csh#if ( $COMPILER == "pgi" ) then# module load pgi#endif#module load netcdf limit coredumpsize unlimitedlimit stacksize unlimitedsetenv CESM_PREFIX /scratch/vineetm/CESM/shared #GNUsetenv PATH $CESM_PREFIX/gnu/bin:$PATHsetenv LD_LIBRARY_PATH $CESM_PREFIX/gnu/lib:$CESM_PREFIX/gnu/lib64:$LD_LIBRARY_PATHsetenv LD_RUN_PATH $CESM_PREFIX/gnu/lib:$CESM_PREFIX/gnu/lib64setenv MANPATH $CESM_PREFIX/gnu/share/man:$MANPATH #PGI environmentsetenv pgihome $CESM_PREFIX/pgisetenv pgidir $pgihome/linux86-64/18.4setenv PGI $pgihomesetenv CC $pgidir/bin/pgccsetenv FC $pgidir/bin/pgfortransetenv F90 $pgidir/bin/pgf90setenv F77 $pgidir/bin/pgf77setenv CPP "$pgidir/bin/pgcc -Mcpp"setenv CXX $pgidir/bin/pgc++setenv PATH $pgidir/bin:$PATHsetenv MANPATH $pgidir/man:$MANPATHsetenv LD_LIBRARY_PATH $pgidir/lib:$LD_LIBRARY_PATH #PGI openmpi environmentsetenv pgilibdir $pgihome/linux86-64/2018/mpi/openmpi-2.1.2setenv PGI_OPTL_LIB_DIRS "$pgilibdir/lib"setenv PGI_OPTL_INCLUDE_DIRS "$pgilibdir/include"setenv PATH $pgilibdir/bin:$PATHsetenv MANPATH $pgilibdir/share/man:$MANPATHsetenv LD_LIBRARY_PATH $pgilibdir/lib:$LD_LIBRARY_PATH #DEPSsetenv HDF5_ROOT $CESM_PREFIX/depssetenv PATH $CESM_PREFIX/deps/bin:$PATHsetenv LD_LIBRARY_PATH $CESM_PREFIX/deps/lib:$LD_LIBRARY_PATHsetenv MANPATH $CESM_PREFIX/deps/share/man:$MANPATHsetenv PKG_CONFIG_PATH $CESM_PREFIX/deps/lib/pkgconfigsetenv LD_RUN_PATH $CESM_PREFIX/deps/lib:$LD_RUN_PATH setenv LANG C-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Following is the case that i am setting up: COMPSET=B_1850_CN RES=0.9x1.25_gx1v6 MACH=userdefined CCSMROOT=/scratch/vineetm/CESM/shared/cesm1_2_2_CAMChem CASE=SCASE0 CASEROOT=/scratch/vineetm/CESM/shared/MYCASES EXEROOT=/scratch/vineetm/CESM/shared/MYCASES/SCASE0/EXEC RUNDIR=/scratch/vineetm/CESM/shared/MYCASES/SCASE0/EXEC/run ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Following is the error that I am getting while running: (seq_comm_setcomm) initialize ID ( 1 GLOBAL ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 2 CPL ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 17 ATM ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 18 CPLATM ) join IDs = 2 17 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 3 ALLATMID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 10 CPLALLATMID ) join IDs = 2 3 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 19 LND ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 20 CPLLND ) join IDs = 2 19 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 4 ALLLNDID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 11 CPLALLLNDID ) join IDs = 2 4 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 21 OCN ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 22 CPLOCN ) join IDs = 2 21 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 5 ALLOCNID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 12 CPLALLOCNID ) join IDs = 2 5 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 23 ICE ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 24 CPLICE ) join IDs = 2 23 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 6 ALLICEID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 13 CPLALLICEID ) join IDs = 2 6 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 25 GLC ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 26 CPLGLC ) join IDs = 2 25 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 7 ALLGLCID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 14 CPLALLGLCID ) join IDs = 2 7 ( npes = 128) ( nthreads = 1) (seq_comm_setcomm) initialize ID ( 27 ROF ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 28 CPLROF ) join IDs = 2 27 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 8 ALLROFID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 15 CPLALLROFID ) join IDs = 2 8 ( npes = 128) ( nthreads = 1) seq_comm_setcomm) initialize ID ( 29 WAV ) pelist = 0 127 1 ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 30 CPLWAV ) join IDs = 2 29 ( npes = 128) ( nthreads = 1) (seq_comm_jcommarr) initialize ID ( 9 ALLWAVID ) join multiple comp IDs ( npes = 128) ( nthreads = 1) (seq_comm_joincomm) initialize ID ( 16 CPLALLWAVID ) join IDs = 2 9 ( npes = 128) ( nthreads = 1) (seq_comm_printcomms) 1 0 128 1 GLOBAL: (seq_comm_printcomms) 2 0 128 1 CPL: (seq_comm_printcomms) 3 0 128 1 ALLATMID: (seq_comm_printcomms) 4 0 128 1 ALLLNDID: (seq_comm_printcomms) 5 0 128 1 ALLOCNID: (seq_comm_printcomms) 6 0 128 1 ALLICEID: (seq_comm_printcomms) 7 0 128 1 ALLGLCID: (seq_comm_printcomms) 8 0 128 1 ALLROFID: (seq_comm_printcomms) 9 0 128 1 ALLWAVID: (seq_comm_printcomms) 10 0 128 1 CPLALLATMID: (seq_comm_printcomms) 11 0 128 1 CPLALLLNDID: (seq_comm_printcomms) 12 0 128 1 CPLALLOCNID: (seq_comm_printcomms) 13 0 128 1 CPLALLICEID: (seq_comm_printcomms) 14 0 128 1 CPLALLGLCID: (seq_comm_printcomms) 15 0 128 1 CPLALLROFID: (seq_comm_printcomms) 16 0 128 1 CPLALLWAVID: (seq_comm_printcomms) 17 0 128 1 ATM: (seq_comm_printcomms) 18 0 128 1 CPLATM: (seq_comm_printcomms) 19 0 128 1 LND: (seq_comm_printcomms) 20 0 128 1 CPLLND: (seq_comm_printcomms) 21 0 128 1 OCN: (seq_comm_printcomms) 22 0 128 1 CPLOCN: (seq_comm_printcomms) 23 0 128 1 ICE: (seq_comm_printcomms) 24 0 128 1 CPLICE: (seq_comm_printcomms) 25 0 128 1 GLC: (seq_comm_printcomms) 26 0 128 1 CPLGLC: (seq_comm_printcomms) 27 0 128 1 ROF: (seq_comm_printcomms) 28 0 128 1 CPLROF: (seq_comm_printcomms) 29 0 128 1 WAV: (seq_comm_printcomms) 30 0 128 1 CPLWAV: (t_initf) Read in prof_inparm namelist from: drv_in 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.51 8 MB memory alloc in MB is 8.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.02 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1050.15 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.01 seq_flds_mod: read seq_cplflds_inparm namelist from: drv_in 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.79 8 MB memory alloc in MB is 8.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.51 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1050.15 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.008 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.04 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1049.63 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1019.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.79 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.02 8 MB memory alloc in MB is 8.008 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.04 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1049.63 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.008 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1050.15 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.54 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1029.53 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1027.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.54 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1023.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1030.04 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1022.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1031.05 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1021.01 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1052.26 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1053.32 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.73 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1028.52 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1051.20 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1024.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1026.51 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.50 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1020.02 8 MB memory alloc in MB is 8.00 8 MB memory dealloc in MB is 0.00 Memory block size conversion in bytes is 1025.00 seq_flds_mod: read seq_cplflds_userspec namelist from: drv_in seq_flds_mod: seq_flds_a2x_states= Sa_z:Sa_u:Sa_v:Sa_tbot:Sa_ptem:Sa_shum:Sa_pbot:Sa_dens:Sa_pslv:Sa_co2prog:Sa_co2diag seq_flds_mod: seq_flds_a2x_fluxes= Faxa_rainc:Faxa_rainl:Faxa_snowc:Faxa_snowl:Faxa_lwdn:Faxa_swndr:Faxa_swvdr:Faxa_swndf:Faxa_swvdf:Faxa_swnet:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphi dry:Faxa_ocphodry:Faxa_ocphiwet:Faxa_dstwet1:Faxa_dstwet2:Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4 seq_flds_mod: seq_flds_x2a_states= Sf_lfrac:Sf_ifrac:Sf_ofrac:Sx_avsdr:Sx_anidr:Sx_avsdf:Sx_anidf:Sx_tref:Sx_qref:So_t:Sx_t:Sl_fv:Sl_ram1:Sl_snowh:Si_snowh:So_ssq:So_re:Sx_u10:So_ustar seq_flds_mod: seq_flds_x2a_fluxes= Faxx_taux:Faxx_tauy:Faxx_lat:Faxx_sen:Faxx_lwup:Faxx_evap:Fall_flxdst1:Fall_flxdst2:Fall_flxdst3:Fall_flxdst4 seq_flds_mod: seq_flds_l2x_states= Sl_avsdr:Sl_anidr:Sl_avsdf:Sl_anidf:Sl_tref:Sl_qref:Sl_t:Sl_fv:Sl_ram1:Sl_snowh:Sl_u10 seq_flds_mod: seq_flds_l2x_fluxes= Fall_swnet:Fall_taux:Fall_tauy:Fall_lat:Fall_sen:Fall_lwup:Fall_evap:Fall_flxdst1:Fall_flxdst2:Fall_flxdst3:Fall_flxdst4:Flrl_rofliq:Flrl_rofice seq_flds_mod: seq_flds_x2l_states= Sa_z:Sa_u:Sa_v:Sa_tbot:Sa_ptem:Sa_shum:Sa_pbot:Slrr_volr:Sa_co2prog:Sa_co2diag seq_flds_mod: seq_flds_x2l_fluxes= Faxa_rainc:Faxa_rainl:Faxa_snowc:Faxa_snowl:Faxa_lwdn:Faxa_swndr:Faxa_swvdr:Faxa_swndf:Faxa_swvdf:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphidry:Faxa_oc phodry:Faxa_ocphiwet:Faxa_dstwet1:Faxa_dstwet2:Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4:Flrr_flood seq_flds_mod: seq_flds_i2x_states= Si_avsdr:Si_anidr:Si_avsdf:Si_anidf:Si_tref:Si_qref:Si_t:Si_snowh:Si_u10:Si_ifrac seq_flds_mod: seq_flds_i2x_fluxes= Faii_swnet:Fioi_swpen:Faii_taux:Fioi_taux:Faii_tauy:Fioi_tauy:Faii_lat:Faii_sen:Faii_lwup:Faii_evap:Fioi_melth:Fioi_meltw:Fioi_salt seq_flds_mod: seq_flds_x2i_states= Sa_z:Sa_u:Sa_v:Sa_tbot:Sa_ptem:Sa_shum:Sa_pbot:Sa_dens:So_t:So_s:So_u:So_v:So_dhdx:So_dhdy seq_flds_mod: seq_flds_x2i_fluxes= Faxa_rain:Faxa_snow:Faxa_lwdn:Faxa_swndr:Faxa_swvdr:Faxa_swndf:Faxa_swvdf:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphidry:Faxa_ocphodry:Faxa_ocphiwet:Fax a_dstwet1:Faxa_dstwet2:Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4:Fioo_q seq_flds_mod: seq_flds_o2x_states= So_t:So_s:So_u:So_v:So_dhdx:So_dhdy:So_bldepth seq_flds_mod: seq_flds_o2x_fluxes= Fioo_q seq_flds_mod: seq_flds_x2o_states= Sa_pslv:So_duu10n:Si_ifrac:Sw_lamult:Sw_ustokes:Sw_vstokes:Sw_hstokes seq_flds_mod: seq_flds_x2o_fluxes= Faxa_rain:Faxa_snow:Faxa_prec:Faxa_lwdn:Foxx_swnet:Faxa_bcphidry:Faxa_bcphodry:Faxa_bcphiwet:Faxa_ocphidry:Faxa_ocphodry:Faxa_ocphiwet:Faxa_dstwet1:Faxa_dstwet2: Faxa_dstwet3:Faxa_dstwet4:Faxa_dstdry1:Faxa_dstdry2:Faxa_dstdry3:Faxa_dstdry4:Foxx_taux:Foxx_tauy:Foxx_lat:Foxx_sen:Foxx_lwup:Foxx_evap:Fioi_melth:Fioi_meltw:Fio i_salt:Forr_roff:Forr_ioff seq_flds_mod: seq_flds_s2x_states= seq_flds_mod: seq_flds_s2x_fluxes= seq_flds_mod: seq_flds_x2s_states= seq_flds_mod: seq_flds_x2s_fluxes= seq_flds_mod: seq_flds_g2x_states= seq_flds_mod: seq_flds_g2x_fluxes= seq_flds_mod: seq_flds_x2g_states= seq_flds_mod: seq_flds_x2g_fluxes= seq_flds_mod: seq_flds_xao_states= So_tref:So_qref:So_ssq:So_re:So_u10:So_duu10n:So_ustar seq_flds_mod: seq_flds_xao_albedo= So_avsdr:So_anidr:So_avsdf:So_anidf seq_flds_mod: seq_flds_r2x_states= Slrr_volr seq_flds_mod: seq_flds_r2x_fluxes= Forr_roff:Forr_ioff:Flrr_flood seq_flds_mod: seq_flds_x2r_states= seq_flds_mod: seq_flds_x2r_fluxes= Flrl_rofliq:Flrl_rofice seq_flds_mod: seq_flds_w2x_states= Sw_lamult:Sw_ustokes:Sw_vstokes:Sw_hstokes seq_flds_mod: seq_flds_w2x_fluxes= seq_flds_mod: seq_flds_x2w_states= Sa_u:Sa_v:Sa_tbot:Si_ifrac:So_t:So_u:So_v:So_bldepth seq_flds_mod: seq_flds_x2w_fluxes= 128 pes participating in computation ----------------------------------- TASK# NAME 0 cn00 1 cn00 2 cn00 3 cn00 4 cn00 5 cn00 6 cn00 7 cn00 8 cn00 9 cn00 10 cn00 11 cn00 12 cn00 13 cn00 14 cn00 15 cn00 16 cn00 17 cn00 18 cn00 19 cn00 20 cn00 21 cn00 22 cn00 23 cn00 24 cn00 25 cn00 26 cn00 27 cn00 28 cn01 29 cn01 30 cn01 31 cn01 32 cn01 33 cn01 34 cn01 35 cn01 36 cn01 37 cn01 38 cn01 39 cn01 40 cn01 41 cn01 42 cn01 43 cn01 44 cn01 45 cn01 46 cn01 47 cn01 48 cn01 49 cn01 50 cn01 51 cn01 52 cn01 53 cn01 54 cn01 55 cn01 56 cn02 57 cn02 58 cn02 59 cn02 60 cn02 61 cn02 62 cn02 63 cn02 64 cn02 65 cn02 66 cn02 67 cn02 68 cn02 69 cn02 70 cn02 71 cn02 72 cn02 73 cn02 74 cn02 75 cn02 76 cn02 77 cn02 78 cn02 79 cn02 80 cn02 81 cn02 82 cn02 83 cn02 84 cn03 85 cn03 86 cn03 87 cn03 88 cn03 89 cn03 90 cn03 91 cn03 92 cn03 93 cn03 94 cn03 95 cn03 96 cn03 97 cn03 98 cn03 99 cn03 100 cn03 101 cn03 102 cn03 103 cn03 104 cn03 105 cn03 106 cn03 107 cn03 108 cn03 109 cn03 110 cn03 111 cn03 112 cn04 113 cn04 114 cn04 115 cn04 116 cn04 117 cn04 118 cn04 119 cn04 120 cn04 121 cn04 122 cn04 123 cn04 124 cn04 125 cn04 126 cn04 127 cn04 Opened existing file b40.1850.track1.1deg.006.cam.i.0863-01-01-00000.nc 65536 Opened existing file /scratch/vineetm/CESM/DATA/atm/cam/topo/USGS-gtopo30_0.9x1.25_remap_c051027.nc 131072 NetCDF: Invalid dimension ID or name =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = PID 78992 RUNNING AT cn00 = EXIT CODE: 9 = CLEANING UP REMAINING PROCESSES = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES =================================================================================== [proxy:0:2@cn02] HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:2@cn02] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:2@cn02] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event [proxy:0:3@cn03] HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:3@cn03] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:3@cn03] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event [proxy:0:4@cn04] HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:4@cn04] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:4@cn04] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event [proxy:0:1@cn01] srun: error: cn03: task 3: Exited with exit code 7 srun: error: cn02: task 2: Exited with exit code 7 srun: error: cn01: task 1: Exited with exit code 7 HYD_pmcd_pmip_control_cmd_cb (pm/pmiserv/pmip_cb.c:887): assert (!closed) failed [proxy:0:1@cn01] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status [proxy:0:1@cn01] main (pm/pmiserv/pmip.c:202): demux engine error waiting for event srun: error: cn04: task 4: Exited with exit code 7 [mpiexec@cn00] HYDT_bscu_wait_for_completion (tools/bootstrap/utils/bscu_wait.c:76): one of the processes terminated badly; aborting [mpiexec@cn00] HYDT_bsci_wait_for_completion (tools/bootstrap/src/bsci_wait.c:23): launcher returned error waiting for completion [mpiexec@cn00] HYD_pmci_wait_for_completion (pm/pmiserv/pmiserv_pmci.c:218): launcher returned error waiting for completion [mpiexec@cn00] main (ui/mpich/mpiexec.c:340): process manager error waiting for completion Wed Nov 14 16:22:34 IST 2018 -- CSM EXECUTION HAS FINISHED ls: No match. ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- The dependencies have been well tested. Not sure what the problem is. Please let me know what should be the changes required. Thanks,Vineet More