[restart archiving failure] err=ncdump: locfnh: No such variable

[dayon]

Hi, scientists.
currently, I run the cesm2.1.3 with the "Clm50SpGs" compset, and the time of simluation is from 1980-01-01 to 1981-01-01
after create case, I set the xml file with below commands

./xmlchange NTASKS=80
./xmlchange DATM_CLMNCEP_YR_ALIGN=1980
./xmlchange DATM_CLMNCEP_YR_START=1980
./xmlchange DATM_CLMNCEP_YR_END=1980
./xmlchange RUN_STARTDATE=1980-01-01
./xmlchange STOP_N=12
./xmlchange STOP_OPTION=nmonths
./xmlchange CLM_FORCE_COLDSTART='on'
./xmlchange REST_OPTION=nmonths
./xmlchange REST_N=3

after ./cas.submit, the model execution can finish, BUT, when Archiving restarts for date, it failure, the WARNING and err is:
WARNING: ncdump -v locfnh /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.rh0.1980-04-01-00000.nc failed rc=1
out=
err=ncdump: locfnh: No such variable

Does anybody know what caused the error? Any reply is appreciated, and thanks in advance.

---

The display is shown below:

---

2020-12-19 18:02:28 MODEL EXECUTION BEGINS HERE
run command is mpirun -np 80 /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/bld/cesm.exe >> cesm.log.$LID 2>&1
2020-12-20 03:30:13 MODEL EXECUTION HAS FINISHED
check for resubmit
dout_s True
mach ubuntu
resubmit_num 0
Submit job case.st_archive
Starting job script case.st_archive
st_archive starting
moving /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/rof.log.201219-180227.gz to /home/dayon/cesm/archive/CLM50SpGs_hcru_ecmwf/logs/rof.log.201219-180227.gz
moving /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/cesm.log.201219-180227.gz to /home/dayon/cesm/archive/CLM50SpGs_hcru_ecmwf/logs/cesm.log.201219-180227.gz
moving /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/atm.log.201219-180227.gz to /home/dayon/cesm/archive/CLM50SpGs_hcru_ecmwf/logs/atm.log.201219-180227.gz
moving /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/cpl.log.201219-180227.gz to /home/dayon/cesm/archive/CLM50SpGs_hcru_ecmwf/logs/cpl.log.201219-180227.gz
moving /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/lnd.log.201219-180227.gz to /home/dayon/cesm/archive/CLM50SpGs_hcru_ecmwf/logs/lnd.log.201219-180227.gz
-------------------------------------------
Archiving restarts for date date(1980, 4, 1, 0, 0, 0)
-------------------------------------------
Archiving restarts for datm (atm)
Archiving restarts for clm (lnd)
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.r.1980-04-01-00000.nc
WARNING: ncdump -v locfnh /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.rh0.1980-04-01-00000.nc failed rc=1
out=
err=ncdump: locfnh: No such variable
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.rh0.1980-04-01-00000.nc
Archiving restarts for mosart (rof)
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.mosart.r.1980-04-01-00000.nc
WARNING: ncdump -v locfnh /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.mosart.rh0.1980-04-01-00000.nc failed rc=1
out=
err=ncdump: locfnh: No such variable
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.mosart.rh0.1980-04-01-00000.nc
Archiving restarts for drv (cpl)
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.cpl.r.1980-04-01-00000.nc
Archiving restarts for dart (esp)
-------------------------------------------
Archiving restarts for date date(1980, 7, 1, 0, 0, 0)
-------------------------------------------
Archiving restarts for datm (atm)
Archiving restarts for clm (lnd)
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.r.1980-07-01-00000.nc
WARNING: ncdump -v locfnh /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.rh0.1980-07-01-00000.nc failed rc=1
out=
err=ncdump: locfnh: No such variable
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.clm2.rh0.1980-07-01-00000.nc
Archiving restarts for mosart (rof)
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.mosart.r.1980-07-01-00000.nc
WARNING: ncdump -v locfnh /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.mosart.rh0.1980-07-01-00000.nc failed rc=1
out=
err=ncdump: locfnh: No such variable
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.mosart.rh0.1980-07-01-00000.nc
Archiving restarts for drv (cpl)
removing interim restart file /home/dayon/cesm/scratch/CLM50SpGs_hcru_ecmwf/run/CLM50SpGs_hcru_ecmwf.cpl.r.1980-07-01-00000.nc
Archiving restarts for dart (esp)
-------------------------------------------

 

[oleson]

I get the same errors in my own simulations, not sure why. Seems to be a harmless warning since the actual archiving works fine for me.

 

[Qinlu]

Hi, dayon. I wanna know if this problem has been solved? And what caused it? I got the same problem: I tried to run the results from 1900-1920, but this problem occurred in 1913.​