Case Run Error

[hsalah]

Hello,

I'm currently running a case and I get the error (from Case Status):
case.run error
ERROR: RUN FAIL: Command 'mpiexec_mpt -p "%g:" -np 384 omplace -tm open64 /glade/scratch/hsalah/ECLIPSE2014_3/bld/cesm.exe >> cesm.log.$LID 2>&1 ' failed
See log file for details: /glade/scratch/hsalah/ECLIPSE2014_3/run/cesm.log.8093334.chadmin1.ib0.cheyenne.ucar.edu.210510-102131

In the cesm stdout spews this error from all the tasks: ERROR: Unknown error submitted to shr_abort_abort

I do not know how to fix this error, any help is appreciated.

Thank you,

 

[nusbaume]

Hi hsalah,

It looks your model failure was caused by this error that was output to the atm.log file in your run directory:

FIND_TIMES: Failed to find dates bracketing desired time =
735233.000000000
datatm = 731947.750000000
datatp = 731947.875000000
all_data_times = 731947.000000000 731947.125000000
731947.250000000 731947.375000000 731947.500000000
731947.625000000 731947.750000000 731947.875000000

This error occurred in the specified dynamics section of the code. I don't know exactly what your simulation set-up is, but hopefully that error provides the info you need?

Also, the abort message should have provided at least some information, so I am opening an official issue so that future versions of the model output a specific message when this error occurs.

Hope that helps, and have a great day!

Jesse

 

[nicolas cruz]

I have the same error, change the data with for CEDS2015 --compset FCSD --res f09_g17 experiment:
./xmlchange RUN_STARTDATE=2014-01-01
./xmlchange STOP_OPTION=nyears


./xmlchange STOP_N=1
./xmlchange RESUBMIT=1

ERROR: Unknown error submitted to shr_abort_abort.
FIND_TIMES: Failed to find dates bracketing desired time = 735233.
datatm = 731947.75
datatp = 731947.875
FIND_TIMES: Failed to find dates bracketing desired time = 735233.
FIND_TIMES: Failed to find dates bracketing desired time = 735233.
all_data_times = 731947., 731947.125, 731947.25, 731947.375, 731947.5, 731947.625, 731947.75, 731947.875
datatm = 731947.75

 

[nicolas cruz]

I have the same error, change the data with for CEDS2015 --compset FCSD --res f09_g17 experiment:
then
./xmlchange STOP_OPTION=nyears


./xmlchange STOP_N=1
./xmlchange RESUBMIT=1

ERROR: Unknown error submitted to shr_abort_abort.
FIND_TIMES: Failed to find dates bracketing desired time = 735233.
datatm = 731947.75
datatp = 731947.875
FIND_TIMES: Failed to find dates bracketing desired time = 735233.
FIND_TIMES: Failed to find dates bracketing desired time = 735233.
all_data_times = 731947., 731947.125, 731947.25, 731947.375, 731947.5, 731947.625, 731947.75, 731947.875
datatm = 731947.75

the issue was resolved by swapping dates according to the initial condition date.
MERRA2_0.9x1.25_20050101.nc
MERRA2_0.9x1.25_20050102.nc
MERRA2_0.9x1.25_20050103.nc
MERRA2_0.9x1.25_20050104.nc
then:
./xmlchange RUN_STARTDATE=2005-01-01