Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

CESM/CAM run terminates with : Problem not mentioned clearly

R

rambhari0123@gmail_com

Member
Dear Users, I am running cesm/cam with prescribed SST and SIC. I set the future forcings as RCP85 and GHG ramped. Treminated after sucessfully running for 7 months. cesm log shows many lines of messages as given below. QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   1912 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-9.7E-12 at i,k=   1  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1792 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-5.6E-06 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1792 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-5.6E-06 at i,k=  12 10
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.9E-05 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.9E-05 at i,k=  12 10
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   1914 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-6.7E-12 at i,k=   1  1
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   1916 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-1.1E-12 at i,k=   1  1
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   2744 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-5.1E-11 at i,k=   1  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1792 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-4.7E-07 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1792 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-4.7E-07 at i,k=  12 10
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.3E-05 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.3E-05 at i,k=  12 10
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   2743 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-1.5E-11 at i,k=   1  1
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=    549 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-2.8E-12 at i,k=   3  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=    814 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-6.0E-05 at i,k=  16 12
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=    814 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-6.0E-05 at i,k=  16 12
 QNEG3 from vertical diffusion/num_a3:m= 25 lat/lchnk=   2215 Min. mixing ratio violated at    1 points.  Reset to  1.0E-36 Worst =-8.0E+00 at i,k=   4 30
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   1407 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-8.5E-10 at i,k=   1  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.0E-05 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.0E-05 at i,k=  12 10
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   3183 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-5.4E-12 at i,k=   1  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-2.5E-05 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-2.5E-05 at i,k=  12 10
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   1056 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-2.4E-10 at i,k=   1  1
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   2976 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-2.2E-11 at i,k=   1  1
 QNEG3 from vertical diffusion/num_a3:m= 25 lat/lchnk=   2215 Min. mixing ratio violated at    1 points.  Reset to  1.0E-36 Worst =-7.5E+00 at i,k=   4 30
  filew failed, worst i, j, qtmp, q =             1           36
  -3.0421084107672717E-028   3.5643806385938914E-032
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   3182 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-8.0E-11 at i,k=   1  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1792 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-2.7E-05 at i,k=  12  9
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1792 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-2.7E-05 at i,k=  12  9
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.5E-05 at i,k=  12 10
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=   1793 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.5E-05 at i,k=  12 10
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   2976 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-2.6E-11 at i,k=   1  1
 QNEG3 from zm_convr/Q:m=  1 lat/lchnk=    814 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.6E-04 at i,k=  16 11
 QNEG3 from convect_deep/Q:m=  1 lat/lchnk=    814 Min. mixing ratio violated at    1 points.  Reset to  1.0E-12 Worst =-1.6E-04 at i,k=  16 11
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   2976 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-9.9E-11 at i,k=   1  1
 QNEG3 from vertical diffusion/num_a3:m= 25 lat/lchnk=   2215 Min. mixing ratio violated at    1 points.  Reset to  1.0E-36 Worst =-1.0E+01 at i,k=   4 30
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   3186 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-4.3E-11 at i,k=   1  1
 QNEG3 from TPHYSBCb:m=  5 lat/lchnk=   2650 Min. mixing ratio violated at    1 points.  Reset to  0.0E+00 Worst =-1.8E-11 at i,k=   1  1
 QNEG3 from chemistry/num_a2:m= 21 lat/lchnk=   1792 Min. mixing ratio violated at   12 points.  Reset to  1.0E-36 Worst =-7.5E-09 at i,k=  12 25
--------------------------------------------------------------------------
mpirun noticed that process rank 222 with PID 0 on node cn146.hpc.iitd.ac.in exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

I didn't get any clue on the origin of proble. I faced the similar problem in another run which sucessfully simulated 17 years before crashing. I am attaching all the logs of current run. Please help me in resolving the issue.
Thanking you in anticipation. 
 
You must log in or register to reply here.
Top