Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

very slow run with memery leaking problem

xgao304

Member
I am running the compset I2000Clm50SpGs (DATM, clm5 with satellite phenology, river MOSART, stub ice/ocn/GLC/WAV), but I found the model runs very slow. Also, there is memory leaking problem which can cause the model to crash after running for a while (in my test case, 17 months). I am wondering if that is normal speed with most of components stub and data atmosphere and what cause the memory leaking problem as well as how to solve it.Here is the summary of timing information:32 CPU  - 1.696 yr/day 64 CPU  - 3.243 yr/day128 CPU  - 6.299 yr/day512 CPU  ~ 10 yr/dayFor the memory leaking problem, Here is the end of cesm.log file. The memory is leaking and then model crashes when there is nothing left.  max rss=1780.1 MB
  max rss=1783.1 MB
  max rss=1786.3 MB
  max rss=1789.4 MB
  max rss=1792.5 MB
  max rss=1795.6 MB
  max rss=1798.7 MB
  max rss=1801.8 MB
  max rss=1804.9 MB
  max rss=1808.0 MB
  max rss=1811.2 MB
  max rss=1814.3 MB
  max rss=1817.4 MB
0: ALLOCATE: 853520 bytes requested; not enough memory
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:

  Process name: [[37461,1],33]
  Exit code:    127
--------------------------------------------------------------------------

Thanks,Xiang 
 
Top