ERROR: component_mod:check_fields NaN found in ATM instance: 1 field Sa_z 1d global 452: index: 4767

[James King]

Hi all,

I have a user-defined CESM2.2.0 compset on Cheyenne which runs fine. However, after changing the initial condition files used, it fails to run beyond the first timestep with the following error in cesm.log:

ERROR: component_mod:check_fields NaN found in ATM instance: 1 field Sa_z 1d global 452: index: 4767

This implies an error in CAM but there are no error messages in the atm.log. A few people have posted about this error but no-one seems to have resolved it. What I tried to do with initial conditions was interpolate the CAM IC file at /glade/p/cesmdata/cseg/inputdata/cesm2_init/b.e21.BWHIST.f09_g17.CMIP6-historical-WACCM.001/2015-01-01 onto a 32-level CAM6 grid using the supplied tool interpic_new, which I have successfully done in the past. What might be causing this error and what could I do to fix it? Atm and cpl log files are attached (the cesm log is too large to attach, the last few lines are below).

0: Opening file SSP1_transient_test_01.cism.initial_hist.2015-01-01-00000.nc fo
0: r output;
0: Write output at start of run and every 1.00000000000000 years
0: Creating variables internal_time, time, and tstep_count
0: Creating variable level
0: Creating variable lithoz
0: Creating variable staglevel
0: Creating variable stagwbndlevel
0: Creating variable x0
0: Creating variable x1
0: Creating variable y0
0: Creating variable y1
0: Creating variable artm
0: Creating variable smb
0: Creating variable thk
0: Creating variable topg
0: Creating variable usurf
0: Writing to file SSP1_transient_test_01.cism.initial_hist.2015-01-01-00000.nc
0: at time 0.000000000000000E+000
0: WHL: oc_tavg_helper is not associated; associate now
0: Opening file SSP1_transient_test_01.cism.tavg_helper.0000-00-00-00000.nc for
0: output;
0: Write output every 9999999.00000000 years
0: Creating variables internal_time, time, and tstep_count
0: Creating variable level
0: Creating variable lithoz
0: Creating variable staglevel
0: Creating variable stagwbndlevel
0: Creating variable x0
0: Creating variable x1
0: Creating variable y0
0: Creating variable y1
0: Creating variable artm
0: Creating variable smb
0: Creating variable thk
0: Creating variable topg
0: Creating variable usurf
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: RGSMap indices not increasing...Will correct
0:MCT::m_Router::initp_: GSMap indices not increasing...Will correct
502: ERROR:
502: component_mod:check_fields NaN found in ATM instance: 1 field Sa_z 1d global
502: index: 4865

Thanks,

James