Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Running single point CLM simulation but most the the output files shows zero value

Jyoti Singh

Jyoti Singh
Member
I am running CLM for a single point using atmospheric forcings from an experimental site (Xiaoji, China). The simulation completed successfully. However, most of the output variables (e.g., GDD0, GDD0, GDDPLANT) have values of 0. I also checked the temperature field (TSA, TA, A5TMIN), and these have a value of approximately 265 Kelvin which does not match the input climate forcing. The run is a startup using initial conditions taken from a global run extracted using the use_init_interp function in user_nl_clm. The plot below is the holy temperature from the input atmospheric forcing.
1650911633379.png

The case is here /glade/work/jyotis/point_runs/i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-xiaoji.007

The details my case goes here:
env_run.xml
Code:
./xmlchange CLM_USRDAT_NAME=1x1pt_CH-XIA
./xmlchange DATM_CLMNCEP_YR_START=2011
./xmlchange DATM_CLMNCEP_YR_END=2013
./xmlchange DATM_CLMNCEP_YR_ALIGN=1
./xmlchange MPILIB=mpi-serial
./xmlchange ATM_DOMAIN_PATH=/glade/work/jyotis/inputdata/1x1pt_CH-XIA
./xmlchange LND_DOMAIN_PATH=/glade/work/jyotis/inputdata/1x1pt_CH-XIA
./xmlchange ATM_DOMAIN_FILE=domain.lnd.1x1pt_CH-XIA_navy.220314.nc
./xmlchange LND_DOMAIN_FILE=domain.lnd.1x1pt_CH-XIA_navy.220314.nc
./xmlchange DIN_LOC_ROOT=/glade/work/jyotis/inputdata
./xmlchange DIN_LOC_ROOT_CLMFORC=/glade/work/jyotis/inputdata/atm/datm7
./xmlchange RUN_STARTDATE=2011-09-01
./xmlchange --file env_run.xml --id STOP_OPTION --val date
./xmlchange STOP_DATE=20131230
./xmlchange --file env_run.xml --id DATM_MODE --val CLM1PT
./xmlchange CLM_FORCE_COLDSTART=off

user_nl_clm
Code:
paramfile = '/glade/work/jyotis/inputdata/editparam/clm5_params.c171117.nc'
fsurdat = '/glade/work/jyotis/inputdata/lnd/clm2/surfdata_map/surfdata_1x1pt_CH-XIA_hist_78pfts_CMIP6_simyr2000_c220314.nc'
finidat = '/glade/scratch/jyotis/i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-init-clm2.001/run/i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-init-clm2.001.clm2.r.2011-09-01-00000.nc'
use_init_interp = .true.
hist_mfilt = 1,365,1460,8760
hist_nhtfrq = 0,-24,-6,-1
hist_fincl2 = 'FCTR','FCEV','FGEV','FSH_V','FSH_G','HBOT','HTOP','ELAI','NDEP_TO_SMINN','NFIX_TO_SMINN','SMINN_TO_PLANT','SUPPLEMENT_TO_SMINN','SMINN','C_ALLOMETRY','N_ALLOMETRY','AVAILC','PLANT_NDEMAND','PLANT_NALLOC','PLANT_CALLOC','SMINN_TO_NPOOL','RETRANSN_TO_NPOOL','TOTPFTN','PFT_NTRUNC','TOTVEGN','TLAI','TSAI','TSA','LEAFC','LEAFN','FROOTC','FROOTN','NPP','NEE','SEEDC','SEEDN','GPP','LIVESTEMC','LIVESTEMN','TOTCOLC','TOTCOLN','TOTECOSYSC','TOTECOSYSN','TOTLITC','TOTLITN','TOTPFTC','TOTPFTN','TOTSOMC','TOTSOMN','TOTVEGC','TOTVEGN','TV','EFLX_LH_TOT','A5TMIN','A10TMIN','DOWNREG','EXCESS_CFLUX','GRAINC_TO_FOOD','GRAINC','GRAINN','GDDTSOI','GDDPLANT','GDDHARV','GDD020','GDD0','GDD10','GDD1020','GDD8','GDD820','CPHASE'
hist_fincl3 = 'GDDPLANT','CPHASE','GDDHARV','GRAINC','GDDTSOI','GDD10','GDD0','GDD8','GDD020','A5TMIN','A10TMIN'
hist_fincl4 = 'GDDPLANT','CPHASE','GDDHARV','GRAINC','GDDTSOI','GDD10','GDD0','GDD8','GDD020','A5TMIN','A10TMIN'
hist_dov2xy = .true.,.false.,.true.,.false.

user_datm.streams.txt.CLM1PT.CLM_USRDAT
Code:
<?xml version="1.0"?>
<file id="stream" version="1.0">
<dataSource>
   GENERIC
</dataSource>
<domainInfo>
  <variableNames>
     time    time
        xc      lon
        yc      lat
        area    area
        mask    mask
  </variableNames>
  <filePath>
     /glade/work/jyotis/inputdata/1x1pt_CH-XIA
  </filePath>
  <fileNames>
     domain.lnd.1x1pt_CH-XIA_navy.220314.nc
  </fileNames>
</domainInfo>
<fieldInfo>
   <variableNames>
     ZBOT     z
        TBOT     tbot
        RH       rh
        WIND     wind
        PRECTmms precn
        FSDS     swdn
        PSRF     pbot
        FLDS     lwdn
   </variableNames>
   <filePath>
     /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA
   </filePath>
   <fileNames>
    2011-02.nc
2011-03.nc
2011-04.nc
2011-05.nc
2011-06.nc
2011-07.nc
2011-08.nc
2011-09.nc
2011-10.nc
2011-11.nc
2011-12.nc
2012-01.nc
2012-02.nc
2012-03.nc
2012-04.nc
2012-05.nc
2012-06.nc
2012-07.nc
2012-08.nc
2012-09.nc
2012-10.nc
2012-11.nc
2012-12.nc
2013-01.nc
2013-02.nc
2013-03.nc
2013-04.nc
2013-05.nc
2013-06.nc
2013-07.nc
2013-08.nc
2013-09.nc
2013-10.nc
2013-11.nc
2013-12.nc
   </fileNames>
   <offset>
      0
   </offset>
</fieldInfo>
</file>
user_nl_datm
Code:
!------------------------------------------------------------------------
! Users should ONLY USE user_nl_datm to change namelists variables
! Users should add all user specific namelist changes below in the form of
! namelist_var = new_namelist_value
! Note that any namelist variable from shr_strdata_nml and datm_nml can
! be modified below using the above syntax
! User preview_namelists to view (not modify) the output namelist in the
! directory $CASEROOT/CaseDocs
! To modify the contents of a stream txt file, first use preview_namelists
! to obtain the contents of the stream txt files in CaseDocs, and then
! place a copy of the  modified stream txt file in $CASEROOT with the string
! user_ prepended.
!------------------------------------------------------------------------
&datm_nml
  decomp = "1d"
  factorfn = "null"
  force_prognostic_true = .false.
  iradsw = 1
  presaero = .true.
  restfilm = "undefined"
  restfils = "undefined"
  wiso_datm = .false.
/
&shr_strdata_nml
  datamode = "CLMNCEP"
  domainfile = "/glade/work/jyotis/inputdata/1x1pt_CH-XIA/domain.lnd.1x1pt_CH-XIA_navy.220314.nc"
  dtlimit = 1.5, 1.5, 1.5
  fillalgo = "nn", "nn", "nn"
  fillmask = "nomask", "nomask", "nomask"
  fillread = "NOT_SET", "NOT_SET", "NOT_SET"
  fillwrite = "NOT_SET", "NOT_SET", "NOT_SET"
  mapalgo = "nn", "nn", "nn"
  mapmask = "nomask", "nomask", "nomask"
  mapread = "NOT_SET", "NOT_SET", "NOT_SET"
  mapwrite = "NOT_SET", "NOT_SET", "NOT_SET"
  readmode = "single", "single", "single"
  streams = "datm.streams.txt.CLM1PT.CLM_USRDAT 1 2011 2013",
      "datm.streams.txt.presaero.clim_2000 1 2000 2000",
      "datm.streams.txt.topo.observed 1 1 1"
  taxmode = "extend", "extend", "extend"
  tintalgo = "nearest", "linear", "lower"
  vectors = "null"
/
 

oleson

Keith Oleson
CSEG and Liaisons
Staff member
From your atm log file, it doesn't look like the datm is advancing the forcing, it's just using the first time slice of the forcing data for each model time step.
One possible problem is that your DATM_CLMNCEP_YR_ALIGN is set to 1. Try setting it to the year you are starting the simulation for (2011).
 

Jyoti Singh

Jyoti Singh
Member
I tried seting DATM_CLMNCEP_YR_ALIGN =2011 in env_run.xml and,
streams = "datm.streams.txt.CLM1PT.CLM_USRDAT 2011 2011 2013", "datm.streams.txt.presaero.clim_2000 1 2000 2000",
"datm.streams.txt.topo.observed 1 1 1" in user_nl_datm and submitted the job. It gives error message.

Here is the tail of cesm.log.3949001.chadmin1.ib0.cheyenne.ucar.edu.220425-133052

Code:
  1 pes participating in computation for CLM

-----------------------------------

NODE#  NAME
(    0)  r6i6n33
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Variable not found
 ERROR: ERROR in CNBalanceCheckMod.F90 at line 353
Image              PC                Routine            Line        Source
cesm.exe           0000000001463D4D  Unknown               Unknown  Unknown
cesm.exe           0000000000D56CE2  shr_abort_mod_mp_         114  shr_abort_mod.F90
cesm.exe           00000000004F749F  abortutils_mp_end          50  abortutils.F90
cesm.exe           0000000000B9ED3D  cnbalancecheckmod         353  CNBalanceCheckMod.F90
cesm.exe           00000000006F1DB0  cnvegetationfacad        1037  CNVegetationFacade.F90
cesm.exe           0000000000500E91  clm_driver_mp_clm         962  clm_driver.F90
cesm.exe           00000000004EC2FB  lnd_comp_mct_mp_l         456  lnd_comp_mct.F90
cesm.exe           0000000000421BB4  component_mod_mp_         728  component_mod.F90
cesm.exe           0000000000407274  cime_comp_mod_mp_        2720  cime_comp_mod.F90
cesm.exe           000000000042185C  MAIN__                    125  cime_driver.F90
cesm.exe           0000000000404F5E  Unknown               Unknown  Unknown
libc-2.22.so       00002AB847F696E5  __libc_start_main     Unknown  Unknown
cesm.exe           0000000000404E69  Unknown               Unknown  Unknown
MPI_Abort: error code = 1001
GPTLprint_memusage: Using bytesperblock=4096
  size=605.2 MB rss=317.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=327.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=327.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.2 MB rss=341.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB

Here is the tail of lnd.log.3949001.chadmin1.ib0.cheyenne.ucar.edu.220425-133052
Code:
hist_htapes_wrapup : Writing current time sample to local history file
 ./i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-xiaoji.007.clm2.h3.2011-09-01-00000.nc
  at nstep =         1766  for history time interval beginning at
   36.7500000000000       and ending at    36.7916666666667

 nbalance warning           2  1.441151880758559E+017  1.041666626760746E+033
 inputs,ffix,nfix,ndep =   2.425108442120668E-005  0.000000000000000E+000
  1.277225562461226E-004
 outputs,lch,roff,dnit =   1.256929520873547E-005  0.000000000000000E+000
  6.662010017428320E-007
 column nbalance error    =   1.441151880758559E+017           2
 Latdeg,Londeg            =    32.5833000000000        119.700000000000
 begnb                    =    727.201267431301
 endnb                    =   1.041666626760746E+033
 delta store              =   1.041666626760746E+033
 input mass               =   1.041666626760746E+033
 output mass              =   2.168672624641233E-004
 net flux                 =   1.041666626760746E+033
 inputs,ffix,nfix,ndep    =   2.425108442120668E-005  0.000000000000000E+000
  1.277225562461226E-004
 outputs,ffix,nfix,ndep   =   1.256929520873547E-005  0.000000000000000E+000
  6.662010017428320E-007
 ENDRUN:
 ERROR: ERROR in CNBalanceCheckMod.F90 at line 353
 

Jyoti Singh

Jyoti Singh
Member
The case runs successfully if I do DATM_CLMNCEP_YR_ALIGN =2011 in env_run.xml and,
in user_nl_datm
Code:
  streams = "datm.streams.txt.CLM1PT.CLM_USRDAT 1 2011 2013",
      "datm.streams.txt.presaero.clim_2000 1 2000 2000",
      "datm.streams.txt.topo.observed 1 1 1"
  taxmode = "extend", "extend", "extend"
  tintalgo = "nearest", "linear", "lower"

But, the problem remains the same of " just using the first time slice of the forcing data for each model time step".
 

Jyoti Singh

Jyoti Singh
Member
I think the problem may be in setting tax mode as described in CLM Technical note.

THE extend OPTION NEEDS TO BE USED WITH CAUTION! It is only invoked by default for the CLM1PT mode and is only intended for the supported urban datasets to extend the data for a single time-step. If you have the model run extensively through periods in this mode you will effectively be repeating that last time-step over that entire period. This means the output of your simulation will be worthless.

The technical note also describes how to set DATM for CLM1PT mode.
1.2.4.5. CLM1PT mode and it’s DATM settings
In CLM1PT mode the model is assumed to have half-hourly or hourly data for a single-point. For the supported datasets that is exactly what it has. But, if you add your own data you may need to make adjustments accordingly. Using the CLM_USRDAT_NAME resolution you can easily extend this mode for your own datasets that may be regional or even global and could be at different temporal frequencies. If you do so you’ll need to make adjustments to your DATM settings. The dataset has all data in a single stream file. The time-stamps of the data were also adjusted so that they are at the middle of the interval. Because, of this the offset is set to zero, and the tintalgo is set to nearest. taxmode is set to extend and mapalgo is set to nn so that simply the nearest point is used.

If you are using your own data for this mode and it’s not at least hourly you’ll want to adjust the DATM settings for it. If the data is three or six hourly, you’ll need to divide it up into separate streams like in CLM_QIAN mode which will require fairly extensive changes to the DATM namelist and streams files. For an example of doing this see Example 5-8.
 

Jyoti Singh

Jyoti Singh
Member
I changed the user_nl_datm as:

Code:
&shr_strdata_nml
  datamode = "CLMNCEP"
  domainfile = "/glade/work/jyotis/inputdata/1x1pt_CH-XIA/domain.lnd.1x1pt_CH-XIA_navy.220314.nc"
  dtlimit = 1.5, 1.5
  fillalgo = "nn", "nn"
  fillmask = "nomask", "nomask"
  fillread = "NOT_SET", "NOT_SET"
  fillwrite = "NOT_SET", "NOT_SET"
  mapalgo = "nn", "nn"
  mapmask = "nomask", "nomask"
  mapread = "NOT_SET", "NOT_SET"
  mapwrite = "NOT_SET", "NOT_SET"
  readmode = "single", "single"
  streams = "datm.streams.txt.CLM1PT.CLM_USRDAT 1 2011 2013",
      "datm.streams.txt.presaero.clim_2000 1 2000 2000"
  taxmode = "cycle", "cycle"
  tintalgo = "nearest", "linear"
  vectors = "null"
/

After this model stops running at 20111007, these are the tail of log file.

atm.log.3950785.chadmin1.ib0.cheyenne.ucar.edu.220425-151018
Code:
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2011-10.nc     323
(datm_comp_run) atm: model date 20111007   61200s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2011-10.nc     324
(datm_comp_run) atm: model date 20111007   63000s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2011-10.nc     325
(datm_comp_run) atm: model date 20111007   64800s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2011-10.nc     326
(datm_comp_run) atm: model date 20111007   66600s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2011-10.nc     327
(datm_comp_run) atm: model date 20111007   68400s

cesm.log.3950785.chadmin1.ib0.cheyenne.ucar.edu.220425-151018
Code:
 1 pes participating in computation for CLM

-----------------------------------

NODE#  NAME
(    0)  r6i6n33
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Variable not found
 ERROR: ERROR in CNBalanceCheckMod.F90 at line 353
Image              PC                Routine            Line        Source
cesm.exe           0000000001463D4D  Unknown               Unknown  Unknown
cesm.exe           0000000000D56CE2  shr_abort_mod_mp_         114  shr_abort_mod.F90
cesm.exe           00000000004F749F  abortutils_mp_end          50  abortutils.F90
cesm.exe           0000000000B9ED3D  cnbalancecheckmod         353  CNBalanceCheckMod.F90
cesm.exe           00000000006F1DB0  cnvegetationfacad        1037  CNVegetationFacade.F90
cesm.exe           0000000000500E91  clm_driver_mp_clm         962  clm_driver.F90
cesm.exe           00000000004EC2FB  lnd_comp_mct_mp_l         456  lnd_comp_mct.F90
cesm.exe           0000000000421BB4  component_mod_mp_         728  component_mod.F90
cesm.exe           0000000000407274  cime_comp_mod_mp_        2720  cime_comp_mod.F90
cesm.exe           000000000042185C  MAIN__                    125  cime_driver.F90
cesm.exe           0000000000404F5E  Unknown               Unknown  Unknown
libc-2.22.so       00002B02381266E5  __libc_start_main     Unknown  Unknown
cesm.exe           0000000000404E69  Unknown               Unknown  Unknown
MPI_Abort: error code = 1001
GPTLprint_memusage: Using bytesperblock=4096
  size=605.2 MB rss=317.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=327.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=327.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.4 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=629.1 MB rss=341.3 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB
  size=635.1 MB rss=347.6 MB share=22.3 MB text=21.2 MB datastack=0.0 MB

lnd.log.3950785.chadmin1.ib0.cheyenne.ucar.edu.220425-151018
Code:
hist_htapes_wrapup : Writing current time sample to local history file
 ./i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-xiaoji.007.clm2.h3.2011-09-01-00000.nc
  at nstep =         1764  for history time interval beginning at
   36.7083333333333       and ending at    36.7500000000000

 clm: completed timestep         1765
 clm: completed timestep         1766

 hist_htapes_wrapup : Writing current time sample to local history file
 ./i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-xiaoji.007.clm2.h3.2011-09-01-00000.nc
  at nstep =         1766  for history time interval beginning at
   36.7500000000000       and ending at    36.7916666666667

 nbalance warning           2  1.441151880758559E+017  1.041666626760746E+033
 inputs,ffix,nfix,ndep =   2.425108442120668E-005  0.000000000000000E+000
  1.277225562461226E-004
 outputs,lch,roff,dnit =   1.256929520873547E-005  0.000000000000000E+000
  6.662010017428320E-007
 column nbalance error    =   1.441151880758559E+017           2
 Latdeg,Londeg            =    32.5833000000000        119.700000000000
 begnb                    =    727.201267431301
 endnb                    =   1.041666626760746E+033
 delta store              =   1.041666626760746E+033
 input mass               =   1.041666626760746E+033
 output mass              =   2.168672624641233E-004
 net flux                 =   1.041666626760746E+033
 inputs,ffix,nfix,ndep    =   2.425108442120668E-005  0.000000000000000E+000
  1.277225562461226E-004
 outputs,ffix,nfix,ndep   =   1.256929520873547E-005  0.000000000000000E+000
  6.662010017428320E-007
 ENDRUN:
 ERROR: ERROR in CNBalanceCheckMod.F90 at line 353
                                                                                                                                                             12174,2       Bot
 

oleson

Keith Oleson
CSEG and Liaisons
Staff member
It looks like the forcing is being read in correctly now. And I don't see anything wrong with the forcing values themselves. It looks like you are simulating winter wheat which is not active normally, I guess it is a development feature? The nitrogen balance error is quite large (on the order of e17) which might imply that something like a fill value is being used (normally these are 1e36). Maybe it has something to do with the phenology that is not working correctly. I would check with the winter wheat developers (@dll@ucar_edu maybe?).
 

Jyoti Singh

Jyoti Singh
Member
Thanks for the suggestion Keith. Actually I have added winter wheat in surface data Map and simulated winter wheat for global run and it worked fine.

However, I implemented your suggestion to check if the problem is arriving due to winter wheat so I changed the surfacdata_map from winter wheat to spring wheat in user_nl_clm. Now PCT_CFT = 100 for irrigated spring what (cft=20).
Planting window foe spring wheat is April 1 to June 15.

I ran the case (/glade/work/jyotis/point_runs/i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-xiaoji.007 ) again. Again the run stops. Following are the tail of log files.
atm.log.3976031.chadmin1.ib0.cheyenne.ucar.edu.220426-135908

Code:
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     659
(datm_comp_run) atm: model date 20120414   59400s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     660
(datm_comp_run) atm: model date 20120414   61200s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     661
(datm_comp_run) atm: model date 20120414   63000s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     662
(datm_comp_run) atm: model date 20120414   64800s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     663
(datm_comp_run) atm: model date 20120414   66600s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     664
(datm_comp_run) atm: model date 20120414   68400s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     665
(datm_comp_run) atm: model date 20120414   70200s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     666
(datm_comp_run) atm: model date 20120414   72000s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     667
(datm_comp_run) atm: model date 20120414   73800s
(shr_dmodel_readstrm) file ub: /glade/work/jyotis/inputdata/atm/datm7/CLM1PT_data/1x1pt_CH-XIA/2012-04.nc     668
(datm_comp_run) atm: model date 20120414   75600s

cesm.log.3976031.chadmin1.ib0.cheyenne.ucar.edu.220426-135908
Code:
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Invalid dimension ID or name
 NetCDF: Variable not found
 NetCDF: Variable not found
 ERROR: ERROR in CNBalanceCheckMod.F90 at line 353
Image              PC                Routine            Line        Source
cesm.exe           0000000001463D4D  Unknown               Unknown  Unknown
cesm.exe           0000000000D56CE2  shr_abort_mod_mp_         114  shr_abort_mod.F90
cesm.exe           00000000004F749F  abortutils_mp_end          50  abortutils.F90
cesm.exe           0000000000B9ED3D  cnbalancecheckmod         353  CNBalanceCheckMod.F90
cesm.exe           00000000006F1DB0  cnvegetationfacad        1037  CNVegetationFacade.F90
cesm.exe           0000000000500E91  clm_driver_mp_clm         962  clm_driver.F90
cesm.exe           00000000004EC2FB  lnd_comp_mct_mp_l         456  lnd_comp_mct.F90
cesm.exe           0000000000421BB4  component_mod_mp_         728  component_mod.F90
cesm.exe           0000000000407274  cime_comp_mod_mp_        2720  cime_comp_mod.F90
cesm.exe           000000000042185C  MAIN__                    125  cime_driver.F90
cesm.exe           0000000000404F5E  Unknown               Unknown  Unknown
libc-2.22.so       00002AEC91D796E5  __libc_start_main     Unknown  Unknown
cesm.exe           0000000000404E69  Unknown               Unknown  Unknown
MPI_Abort: error code = 1001
GPTLprint_memusage: Using bytesperblock=4096
  size=605.2 MB rss=325.0 MB share=22.5 MB text=21.2 MB datastack=0.0 MB
  size=623.2 MB rss=335.0 MB share=22.5 MB text=21.2 MB datastack=0.0 MB

lnd.log.3976031.chadmin1.ib0.cheyenne.ucar.edu.220426-135908
Code:
 clm: completed timestep        10841
 clm: completed timestep        10842

 hist_htapes_wrapup : Writing current time sample to local history file
 ./i.e20.I2000Clm50BgcCrop.1pt.AgMIPOzone-xiaoji.007.clm2.h3.2011-09-01-00000.nc
  at nstep =        10842  for history time interval beginning at
   225.833333333333       and ending at    225.875000000000

 nbalance warning           2  1.441151880758559E+017  1.041666626760746E+033
 inputs,ffix,nfix,ndep =   1.582930437282323E-005  0.000000000000000E+000
  2.495818760216301E-004
 outputs,lch,roff,dnit =   1.923199992896519E-005  0.000000000000000E+000
  3.929994607047252E-007
 column nbalance error    =   1.441151880758559E+017           2
 Latdeg,Londeg            =    32.5833000000000        119.700000000000
 begnb                    =    604.346423312938
 endnb                    =   1.041666626760746E+033
 delta store              =   1.041666626760746E+033
 input mass               =   1.041666626760746E+033
 output mass              =   2.515028199421228E-004
 net flux                 =   1.041666626760746E+033
 inputs,ffix,nfix,ndep    =   1.582930437282323E-005  0.000000000000000E+000
  2.495818760216301E-004
 outputs,ffix,nfix,ndep   =   1.923199992896519E-005  0.000000000000000E+000
  3.929994607047252E-007
 ENDRUN:
 ERROR: ERROR in CNBalanceCheckMod.F90 at line 353

Errors in CESM and LND log files are same as it was for winter wheat. The only difference between errors for winter and spring wheat is related to the date it stops and ATM log file.
In this case the runs stops at 20120414 which may be just after the planting (planting starts from 1 April).
In the case of winter wheat the run stops at 20111130 (which is within the planting window of winter wheat) and that may be after planting.
 

oleson

Keith Oleson
CSEG and Liaisons
Staff member
I wonder if it is because there are fill values for this field on the surface dataset:

CONST_FERTNITRO_CFT

The values are all 9.99999961690316e+35. Seems like they should either be zero or small non-zero.
 

Jyoti Singh

Jyoti Singh
Member
I changed CONST_FERTNITRO_CFT = 0 in surface dataset and it is running now with meaningful outputs.
Thankyou very much, I would have never occurred to me that this error was due to incorrect values in surface dataset.
 
Top