jbuzan@purdue_edu
Member
Hello CESM Developers,
I am attempting to execute a Fixed Ocean SST simulation for the Last Glacial Maximum (LGM).
I am encountering the following error below. I am not sure how to interpret this error. I saw a post from January 2020 about ice thermo, but my error is not stating that ice was the issue (although, ice and cpl were the last logs written). Unfortunately, I am not making it through the first time step, so the suggestions from:
are not quite useful because I am not seeing anything outputted.
I tried to invoke
print_points = .true.
build-namelist - ERROR: Invalid namelist variable in '-infile' /scratch/snx3000/jbuzan/cases/Production_Runs/F.LGM.Test.07_0_CN.x1.122/Buildconf/ciceconf/cesm_namelist.
ERROR: in _validate_pair (package Build::NamelistDefinition): Variable name print_points not found in
/users/jbuzan/cesm1_2_2/models/ice/cice/bld/namelist_files/namelist_definition.xml
ERROR: cice.buildnml.csh failed
I am not sure how to proceed in diagnosing this error.
Cheers,
-Jonathan
cesm.log:
(shr_stream_set) filename = /scratch/snx3000/jbuzan/file_analysis/LGM_CNTL.05_0_CN.x2.122/sst_ice/double/LGM_CNTL.05_0_CN.x2.122.sst_ice.fv0.9x1.25.metadata.02-35.avg.nc
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_AttrVectComms::GSM_scatter_: myID = 0. Invalid input, GSMap%gsize = 259200, lsize(iV) = 64800
shr_mct_sMatReaddnc: Error on scatter of areadst0
290.MCT(MPEU)::die.: from shr_mct_sMatReaddnc()
Rank 656 [Thu Jul 30 09:32:51 2020] [c5-0c0s8n2] application called MPI_Abort(MPI_COMM_WORLD, 2) - process 656
forrtl: error (76): Abort trap signal
cpl.log:
(seq_mct_drv) : Initializing mapper_Fl2r
(seq_map_init_rcfile) called for mapper_Fl2r initialization
(shr_mct_sMatPInitnc) Initializing SparseMatrixPlus
(shr_mct_sMatPInitnc) map weight filename /scratch/snx3000/jbuzan/modified_inputdata/LGM_jrb/map_r19_nomask_TO_r1x1_aave.200630.nc
(shr_mct_sMatPInitnc) SmatP maptype X
(shr_mct_sMatReaddnc) reading mapping matrix data decomposed...
(shr_mct_sMatReaddnc) * file name : /scratch/snx3000/jbuzan/modified_inputdata/LGM_jrb/map_r19_nomask_TO_r1x1_aave.200630.nc
(shr_mct_sMatReaddnc) * matrix dims src x dst : 55296 x 64800
(shr_mct_sMatReaddnc) * number of non-zero elements: 239760
ice.log:
(shr_stream_set) size of filename = 1
(shr_stream_set) filename = /scratch/snx3000/jbuzan/file_analysis/LGM_CNTL.05_0_CN.x2.122/sst_ice/double/LGM_CNTL.05_0_CN.x2.122.sst_ice.fv0.9x1.25.metadata.02-35.avg.nc
(shr_strdata_init) calling shr_dmodel_mapSet for remap
(shr_strdata_print) ----------------------------------------------------------
(shr_strdata_print) name = SPRESICE data
(shr_strdata_print) dataMode = NULL
(shr_strdata_print) domainFile = null
(shr_strdata_print) nxg = 320
(shr_strdata_print) nyg = 384
(shr_strdata_print) calendar = NO_LEAP
(shr_strdata_print) io_type = 6
(shr_strdata_print) eccen = 1.000000E+36
(shr_strdata_print) mvelpp = 1.000000E+36
(shr_strdata_print) lambm0 = 1.000000E+36
(shr_strdata_print) obliqr = 1.000000E+36
(shr_strdata_print) nstreams = 1
(shr_strdata_print) pio_iotype = 6
(shr_strdata_print) streams ( 1) = null
(shr_strdata_print) taxMode ( 1) = cycle
(shr_strdata_print) dtlimit ( 1) = 1.500000E+00
(shr_strdata_print) strnxg ( 1) = 288
(shr_strdata_print) strnyg ( 1) = 192
(shr_strdata_print) dofill ( 1) = F
(shr_strdata_print) fillalgo( 1) = none
(shr_strdata_print) fillmask( 1) = nomask
(shr_strdata_print) fillread( 1) = NOT_SET
(shr_strdata_print) fillwrit( 1) = NOT_SET
(shr_strdata_print) domaps ( 1) = T
(shr_strdata_print) mapalgo ( 1) = bilinear
(shr_strdata_print) mapmask ( 1) = dstmask
(shr_strdata_print) mapread ( 1) = NOT_SET
(shr_strdata_print) mapwrit ( 1) = NOT_SET
(shr_strdata_print) tintalgo( 1) = linear
(shr_strdata_print)
(shr_strdata_print) nvectors = 0
(shr_strdata_print) ----------------------------------------------------------
I am attempting to execute a Fixed Ocean SST simulation for the Last Glacial Maximum (LGM).
I am encountering the following error below. I am not sure how to interpret this error. I saw a post from January 2020 about ice thermo, but my error is not stating that ice was the issue (although, ice and cpl were the last logs written). Unfortunately, I am not making it through the first time step, so the suggestions from:
FAQ: CICE Thermodynamic convergence errors.
Sometimes the CICE model produces an error like: Thermo iteration does not converge istep1, my_task, i, j: .... (a number of messages and details) (shr_sys_abort) ERROR: ice: Vertical thermo error This is normally indicative of a problem...
bb.cgd.ucar.edu
are not quite useful because I am not seeing anything outputted.
I tried to invoke
print_points = .true.
build-namelist - ERROR: Invalid namelist variable in '-infile' /scratch/snx3000/jbuzan/cases/Production_Runs/F.LGM.Test.07_0_CN.x1.122/Buildconf/ciceconf/cesm_namelist.
ERROR: in _validate_pair (package Build::NamelistDefinition): Variable name print_points not found in
/users/jbuzan/cesm1_2_2/models/ice/cice/bld/namelist_files/namelist_definition.xml
ERROR: cice.buildnml.csh failed
I am not sure how to proceed in diagnosing this error.
Cheers,
-Jonathan
cesm.log:
(shr_stream_set) filename = /scratch/snx3000/jbuzan/file_analysis/LGM_CNTL.05_0_CN.x2.122/sst_ice/double/LGM_CNTL.05_0_CN.x2.122.sst_ice.fv0.9x1.25.metadata.02-35.avg.nc
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
MCT::m_Router::initp_: GSMap indices not increasing...Will correct
MCT::m_AttrVectComms::GSM_scatter_: myID = 0. Invalid input, GSMap%gsize = 259200, lsize(iV) = 64800
shr_mct_sMatReaddnc: Error on scatter of areadst0
290.MCT(MPEU)::die.: from shr_mct_sMatReaddnc()
Rank 656 [Thu Jul 30 09:32:51 2020] [c5-0c0s8n2] application called MPI_Abort(MPI_COMM_WORLD, 2) - process 656
forrtl: error (76): Abort trap signal
cpl.log:
(seq_mct_drv) : Initializing mapper_Fl2r
(seq_map_init_rcfile) called for mapper_Fl2r initialization
(shr_mct_sMatPInitnc) Initializing SparseMatrixPlus
(shr_mct_sMatPInitnc) map weight filename /scratch/snx3000/jbuzan/modified_inputdata/LGM_jrb/map_r19_nomask_TO_r1x1_aave.200630.nc
(shr_mct_sMatPInitnc) SmatP maptype X
(shr_mct_sMatReaddnc) reading mapping matrix data decomposed...
(shr_mct_sMatReaddnc) * file name : /scratch/snx3000/jbuzan/modified_inputdata/LGM_jrb/map_r19_nomask_TO_r1x1_aave.200630.nc
(shr_mct_sMatReaddnc) * matrix dims src x dst : 55296 x 64800
(shr_mct_sMatReaddnc) * number of non-zero elements: 239760
ice.log:
(shr_stream_set) size of filename = 1
(shr_stream_set) filename = /scratch/snx3000/jbuzan/file_analysis/LGM_CNTL.05_0_CN.x2.122/sst_ice/double/LGM_CNTL.05_0_CN.x2.122.sst_ice.fv0.9x1.25.metadata.02-35.avg.nc
(shr_strdata_init) calling shr_dmodel_mapSet for remap
(shr_strdata_print) ----------------------------------------------------------
(shr_strdata_print) name = SPRESICE data
(shr_strdata_print) dataMode = NULL
(shr_strdata_print) domainFile = null
(shr_strdata_print) nxg = 320
(shr_strdata_print) nyg = 384
(shr_strdata_print) calendar = NO_LEAP
(shr_strdata_print) io_type = 6
(shr_strdata_print) eccen = 1.000000E+36
(shr_strdata_print) mvelpp = 1.000000E+36
(shr_strdata_print) lambm0 = 1.000000E+36
(shr_strdata_print) obliqr = 1.000000E+36
(shr_strdata_print) nstreams = 1
(shr_strdata_print) pio_iotype = 6
(shr_strdata_print) streams ( 1) = null
(shr_strdata_print) taxMode ( 1) = cycle
(shr_strdata_print) dtlimit ( 1) = 1.500000E+00
(shr_strdata_print) strnxg ( 1) = 288
(shr_strdata_print) strnyg ( 1) = 192
(shr_strdata_print) dofill ( 1) = F
(shr_strdata_print) fillalgo( 1) = none
(shr_strdata_print) fillmask( 1) = nomask
(shr_strdata_print) fillread( 1) = NOT_SET
(shr_strdata_print) fillwrit( 1) = NOT_SET
(shr_strdata_print) domaps ( 1) = T
(shr_strdata_print) mapalgo ( 1) = bilinear
(shr_strdata_print) mapmask ( 1) = dstmask
(shr_strdata_print) mapread ( 1) = NOT_SET
(shr_strdata_print) mapwrit ( 1) = NOT_SET
(shr_strdata_print) tintalgo( 1) = linear
(shr_strdata_print)
(shr_strdata_print) nvectors = 0
(shr_strdata_print) ----------------------------------------------------------