The CESM1.2.2 successfully ran finished, but the results were not archived

[1036668667@qq_com]

Dear everyone,        I need your help, The model ran finished successfully, but the results were not archived. the results and the restart file still in the $RUNDIR                -compset B20TRBPRP -res f09_g16 -mach Tianhe2             At the end of the log file — slurm.out, the error information can be found：       《 NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name Opened file exp1.cam.rs.1851-01-01-00000.nc to write      655360Sun Apr 28 18:08:08 CST 2019 -- CSM EXECUTION HAS FINISHEDls: No match.Model did not complete - no cesm.log file present - exiting 》 ---------------------------------  but the in the cpl.log file , the successful information can be found:

(seq_mct_drv): ===============       SUCCESSFUL TERMINATION OF CPL7-CCSM ===============(seq_mct_drv): ===============        at YMD,TOD = 18510101       0      ===============(seq_mct_drv): ===============  # simulated days (this run) =   365.000  ===============(seq_mct_drv): ===============  compute time (hrs)          =     4.664  ===============(seq_mct_drv): ===============  # simulated years / cmp-day =     5.145  ===============(seq_mct_drv): ===============  pes min memory highwater  (MB)  584.158  ===============(seq_mct_drv): ===============  pes max memory highwater  (MB)  844.205  ===============(seq_mct_drv): ===============  pes min memory last usage (MB)   -0.001  ===============(seq_mct_drv): ===============  pes max memory last usage (MB)   -0.001  =============== 

        The settings are as follows （env_run.xml）：  How can I solve this problem? I look forward to your reply. Thank you very much!

 

[jedwards]

Sounds like this is the problem:https://bb.cgd.ucar.edu/cesm122-problem-creating-timing-files-when-doutstrue

 

[1036668667@qq_com]

Thank you for your help.I found the default settings in the file($CASEROOT/Tools/cesm_postrun_setup ) is that :# -------------------------------------------------------------------------# Perform short term archiving of output# -------------------------------------------------------------------------cd $CASEROOTif ($DOUT_S == 'TRUE') then  echo "Archiving cesm output to $DOUT_S_ROOT"  echo "Calling the short-term archiving script st_archive.sh"  cd $RUNDIR; $CASETOOLS/st_archive.sh; cd $CASEROOTendif  and my cesm version is 1.2.2. So how can i solve this problem. thank you very much. 

 

[jedwards]

Is there a cesm.log in your run directory?   Did you perhaps change the name of that file?

 

[1036668667@qq_com]

Thanks for your help, I check it. There is not a cesm.log file in the run directory, and  I find the information in the slurm-1645311.out《..... NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name Opened file exp1.cam.rs.1851-01-01-00000.nc to write      655360Sun Apr 28 18:08:08 CST 2019 -- CSM EXECUTION HAS FINISHEDls: No match.Model did not complete - no cesm.log file present - exiting  》I uploaded a picture of surlm.out. 

 

[jedwards]

I think that you must have an incorrectly formated mpiexec or mpirun command.   It should redriect stdout to cesm.log.$LID where LID is a timestamp.

 

[kwzhang]

Dear everyone, I need your help, The model ran finished successfully, but the results were not archived. the results and the restart file still in the $RUNDIR -compset B20TRBPRP -res f09_g16 -mach Tianhe2 At the end of the log file — slurm.out, the error information can be found： 《 NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name NetCDF: Invalid dimension ID or name Opened file exp1.cam.rs.1851-01-01-00000.nc to write 655360Sun Apr 28 18:08:08 CST 2019 -- CSM EXECUTION HAS FINISHEDls: No match.Model did not complete - no cesm.log file present - exiting 》 --------------------------------- but the in the cpl.log file , the successful information can be found:

(seq_mct_drv): =============== SUCCESSFUL TERMINATION OF CPL7-CCSM ===============(seq_mct_drv): =============== at YMD,TOD = 18510101 0 ===============(seq_mct_drv): =============== # simulated days (this run) = 365.000 ===============(seq_mct_drv): =============== compute time (hrs) = 4.664 ===============(seq_mct_drv): =============== # simulated years / cmp-day = 5.145 ===============(seq_mct_drv): =============== pes min memory highwater (MB) 584.158 ===============(seq_mct_drv): =============== pes max memory highwater (MB) 844.205 ===============(seq_mct_drv): =============== pes min memory last usage (MB) -0.001 ===============(seq_mct_drv): =============== pes max memory last usage (MB) -0.001 ===============

The settings are as follows （env_run.xml）： How can I solve this problem? I look forward to your reply. Thank you very much!

Hi,
I am also using the CESM1.2.2 in Tianhe2 and have the same quesiton.The model ran finished successfully, but the results were not archived. Have you solved the problem?
Thanks in advance,
Kaiwen

 

[mlevy]

Hi,
I am also using the CESM1.2.2 in Tianhe2 and have the same quesiton.The model ran finished successfully, but the results were not archived. Have you solved the problem?
Thanks in advance,
Kaiwen

This is the thread referenced earlier: CESM1.2.2 - Problem creating timing files when DOUT_S=TRUE (the URL changed in the 5 years since it was originally posted). Can you try the fix suggested there and let us know if it works?

 

[kwzhang]

This is the thread referenced earlier: CESM1.2.2 - Problem creating timing files when DOUT_S=TRUE (the URL changed in the 5 years since it was originally posted). Can you try the fix suggested there and let us know if it works?

Dear Levy,
Thank you for your nice suggestion. Does the code mentioned in CESM1.2.2 - Problem creating timing files when DOUT_S=TRUE locate in the $CASEROOT/Tools/cesm_postrun_setup?
I checked the default code line in $CASEROOT/Tools/cesm_postrun_setup, and found that the default code is fixed as mentioned in the CESM1.2.2 - Problem creating timing files when DOUT_S=TRUE. See the attached fig below. I don't think the code needs to be fixed anymore.
By the way, I do have a problem in creating timing files directory in the $CASEROOT (see the attached fig below) . The error is
"forrtl: No such file or directory
forrtl: severe (29): file not found, unit 10, file /BIGDATA2/fudan_zuozhy_3/cesm1.2.2/test2_CN1/run/./timing/ccsm_timing_stats"
When I created timing directory in the $RUNDIR before submitting, the error disappeared and the model finished successfully. However, the results are still not achieved, even though DOUT_S=TRUE. Do you think this error is linked to the short term archiving problem?
Best wishes,
Kaiwen