Broken after 200000steps when runing ccsm3

[lxiaojuan8778@163_com]

when I use T31_g3v5 , model broke at the 200000th step.
when I use T42_g3v5 , model broke at the 300000th step.

this is output:

-4.547201950708902E-004 98447.8659437561
nstep, te 199997 3326607755.09192 3.85833907498254
-3.851785983449759E-004 98447.8401230956
nstep, te 199998 3326625766.10930 3.19993214911885
-3.194497619039778E-004 98447.8306511670
nstep, te 199999 3326654037.80413 4.11703460547659
-4.110043584520957E-004 98447.8055882466
[cli_2]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 2
nstep, te 200000 3326663808.41836 4.37407837417391
-4.366651580795464E-004 98447.7896979297
rank 2 in job 1 n047.aipo973.iap.ac.cn_43645 caused collective abort of all ranks
exit status of rank 2: killed by signal 9
[1] Done mpirun -r ssh -np 2 cpl : -np 8 csim : -np 6 clm : -np 24 pop : -np 16 cam
Fri Nov 26 06:53:28 CST 2010 -- CSM EXECUTION HAS FINISHED



I start a CONTINUE_RUN ,and the problem did not occur until now .I estimate it will break after 200000 more steps later.

Any one know how to solve this ??

Thanks.