I have build a default cam with compset (F_1850-PDAY_CAM5) with default SST and SIC. I have started the model from 1950. It run till 1953-09-07 and after this date model crashed. Please find the last few lines of error in cesm.log file mentioned below. Please see the README.case file to know the detail about the case (attached to this request). I have also attached the log file of all components.
-----------------------------------------------------------------
pLCL does not converge and is set to psmin in uwshcu.F90
2.313209493856062E-006 100.731658433989 93880.3663997403
QNEG3 from macro_park/Q:m= 1 lat/lchnk= 7173 Min. mixing ratio violated at 1 points. Reset to 1.0E-12 Worst =-1.8E-05 at i, k= 1 30
QNEG3 from macrop/Q:m= 1 lat/lchnk= 7173 Min. mixing ratio violated at 1 points. Reset to 1.0E-12 Worst =-1.8E-05 at i,k= 1 30
filew failed, worst i, j, qtmp, q = 1 145
-2.490588740619554E-030 2.778435155190049E-034
filew failed, worst i, j, qtmp, q = 1 183
-1.734485972135295E-028 2.968088674577577E-034
filew failed, worst i, j, qtmp, q = 1 183
-1.705078827495713E-028 -1.563895050701092E-028
forrtl: error (73): floating divide by zero
Image PC Routine Line Source
cesm.exe 0000000003B91731 Unknown Unknown Unknown
cesm.exe 0000000003B8FE87 Unknown Unknown Unknown
cesm.exe 0000000003B2AA34 Unknown Unknown Unknown
cesm.exe 0000000003B2A846 Unknown Unknown Unknown
cesm.exe 0000000003ABA31F Unknown Unknown Unknown
cesm.exe 0000000003AC42BF Unknown Unknown Unknown
libpthread.so.0 00002B852FCC5630 Unknown Unknown Unknown
cesm.exe 00000000018A01C8 uwshcu_mp_qsinver 4846 uwshcu.F90
cesm.exe 0000000001838AAF uwshcu_mp_compute 1530 uwshcu.F90
cesm.exe 00000000017FCF1A uwshcu_mp_compute 390 uwshcu.F90
cesm.exe 0000000001AC8713 convect_shallow_m 571 convect_shallow.F90
cesm.exe 0000000000C61D08 physpkg_mp_tphysb 1939 physpkg.F90
cesm.exe 0000000000C47F6B physpkg_mp_phys_r 944 physpkg.F90
cesm.exe 00000000005879C2 cam_comp_mp_cam_r 260 cam_comp.F90
cesm.exe 00000000005725EA atm_comp_mct_mp_a 561 atm_comp_mct.F90
cesm.exe 000000000045DFFC ccsm_comp_mod_mp_ 4079 ccsm_comp_mod.F90
cesm.exe 000000000046792A MAIN__ 91 ccsm_driver.F90
cesm.exe 0000000000414DFE Unknown Unknown Unknown
libc.so.6 00002B85301F6555 Unknown Unknown Unknown
cesm.exe 0000000000414D09 Unknown Unknown Unknown
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
cesm.exe 0000000003B91731 Unknown Unknown Unknown
cesm.exe 0000000003B8FE87 Unknown Unknown Unknown
cesm.exe 0000000003B2AA34 Unknown Unknown Unknown
cesm.exe 0000000003B2A846 Unknown Unknown Unknown
cesm.exe 0000000003ABA31F Unknown Unknown Unknown
cesm.exe 0000000003AC3AAB Unknown Unknown Unknown
libpthread.so.0 00002AE2A337A630 Unknown Unknown Unknown
---------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------
pLCL does not converge and is set to psmin in uwshcu.F90
2.313209493856062E-006 100.731658433989 93880.3663997403
QNEG3 from macro_park/Q:m= 1 lat/lchnk= 7173 Min. mixing ratio violated at 1 points. Reset to 1.0E-12 Worst =-1.8E-05 at i, k= 1 30
QNEG3 from macrop/Q:m= 1 lat/lchnk= 7173 Min. mixing ratio violated at 1 points. Reset to 1.0E-12 Worst =-1.8E-05 at i,k= 1 30
filew failed, worst i, j, qtmp, q = 1 145
-2.490588740619554E-030 2.778435155190049E-034
filew failed, worst i, j, qtmp, q = 1 183
-1.734485972135295E-028 2.968088674577577E-034
filew failed, worst i, j, qtmp, q = 1 183
-1.705078827495713E-028 -1.563895050701092E-028
forrtl: error (73): floating divide by zero
Image PC Routine Line Source
cesm.exe 0000000003B91731 Unknown Unknown Unknown
cesm.exe 0000000003B8FE87 Unknown Unknown Unknown
cesm.exe 0000000003B2AA34 Unknown Unknown Unknown
cesm.exe 0000000003B2A846 Unknown Unknown Unknown
cesm.exe 0000000003ABA31F Unknown Unknown Unknown
cesm.exe 0000000003AC42BF Unknown Unknown Unknown
libpthread.so.0 00002B852FCC5630 Unknown Unknown Unknown
cesm.exe 00000000018A01C8 uwshcu_mp_qsinver 4846 uwshcu.F90
cesm.exe 0000000001838AAF uwshcu_mp_compute 1530 uwshcu.F90
cesm.exe 00000000017FCF1A uwshcu_mp_compute 390 uwshcu.F90
cesm.exe 0000000001AC8713 convect_shallow_m 571 convect_shallow.F90
cesm.exe 0000000000C61D08 physpkg_mp_tphysb 1939 physpkg.F90
cesm.exe 0000000000C47F6B physpkg_mp_phys_r 944 physpkg.F90
cesm.exe 00000000005879C2 cam_comp_mp_cam_r 260 cam_comp.F90
cesm.exe 00000000005725EA atm_comp_mct_mp_a 561 atm_comp_mct.F90
cesm.exe 000000000045DFFC ccsm_comp_mod_mp_ 4079 ccsm_comp_mod.F90
cesm.exe 000000000046792A MAIN__ 91 ccsm_driver.F90
cesm.exe 0000000000414DFE Unknown Unknown Unknown
libc.so.6 00002B85301F6555 Unknown Unknown Unknown
cesm.exe 0000000000414D09 Unknown Unknown Unknown
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
cesm.exe 0000000003B91731 Unknown Unknown Unknown
cesm.exe 0000000003B8FE87 Unknown Unknown Unknown
cesm.exe 0000000003B2AA34 Unknown Unknown Unknown
cesm.exe 0000000003B2A846 Unknown Unknown Unknown
cesm.exe 0000000003ABA31F Unknown Unknown Unknown
cesm.exe 0000000003AC3AAB Unknown Unknown Unknown
libpthread.so.0 00002AE2A337A630 Unknown Unknown Unknown
---------------------------------------------------------------------------------------------------------------------------