memory is increasing with cesm1.2.2 FSDW

HI, I run CESM1.2.2 with the component of FSDW.  After 6 days' run, the process exited on signal 9 (Killed). In the cpl.log file, the used memory increases constantly. Is it memory leak? How can I do to fix it?  Thanks for your suggesions. the cpl.log file is :tStamp_write: model date = 20050102       0 wall clock = 2016-01-15 21:30:45 avg dt =   535.56 dt =   535.56 memory_write: model date = 20050102       0 memory =    1015.09 MB (highwater)          0.00 MB (usage)  (pe=    0 comps= cpl ATM LND OCN ICE GLC ROF WAV) tStamp_write: model date = 20050103       0 wall clock = 2016-01-15 21:39:00 avg dt =   515.51 dt =   495.46 memory_write: model date = 20050103       0 memory =    1576.32 MB (highwater)          0.00 MB (usage)  (pe=    0 comps= cpl ATM LND OCN ICE GLC ROF WAV) tStamp_write: model date = 20050104       0 wall clock = 2016-01-15 21:47:15 avg dt =   508.49 dt =   494.45 memory_write: model date = 20050104       0 memory =    2137.48 MB (highwater)          0.00 MB (usage)  (pe=    0 comps= cpl ATM LND OCN ICE GLC ROF WAV) tStamp_write: model date = 20050105       0 wall clock = 2016-01-15 21:55:29 avg dt =   505.06 dt =   494.78 memory_write: model date = 20050105       0 memory =    2698.72 MB (highwater)          0.00 MB (usage)  (pe=    0 comps= cpl ATM LND OCN ICE GLC ROF WAV) Write restart file at 20050106       0(seq_rest_write)  write rpointer file rpointer.drv (seq_io_wopen)  create file test10.cpl.r.2005-01-06-00000.nc tStamp_write: model date = 20050106       0 wall clock = 2016-01-15 22:06:56 avg dt =   541.29 dt =   686.23  memory_write: model date = 20050106       0 memory =    3260.44 MB (highwater)          0.00 MB (usage)  (pe=    0 comps= cpl ATM LND OCN ICE GLC ROF WAV)
 
The plobem may occur when the running is about 1 hour.If I run tracejob, the masseges is following.Job: 35.NS101/15/2016 16:25:21.938 S    enqueuing into batch, state 1 hop 101/15/2016 16:25:22.187 S    Job Modified at request of root@NS101/15/2016 16:25:22.195 L    Job Run01/15/2016 16:25:22.187 S    Job Run at request of root@NS101/15/2016 16:25:22.195 S    Not sending email: User does not want mail of this type.01/15/2016 17:24:37.081 S    on_job_exit valid pjob: 35.NS1 (substate=50)01/15/2016 17:24:37.300 S    Exit_status=255 resources_used.cput=56252 resources_used.energy_used=0 resources_used.mem=65105364kb                          resources_used.vmem=77210848kb resources_used.walltime=355501/15/2016 17:29:38.726 S    dequeuing from batch, state COMPLETE 
 
Back
Top