Case run suddenly slow down

[Mikasa]

Hello, I am using CESM2.1.3 to make simulation. I have optimized the pelayout to get a relative high speed. This pelayout has proved excellent in many previous runs. After I submit my latest case, it kept high speed for the first day. However, I found the running speed was reduced by half from the second day. I have contacted my HPC staff to detect potential system problem. I also made some short runs to reproduce this problem and I found the CPL COMM TIME is much longer than before. Is there any hint for solving this?

 

[jedwards]

What compset and grid are you using - are these the same as used in the previous runs? Do you have a timing file you can share?

 

[Mikasa]

What compset and grid are you using - are these the same as used in the previous runs? Do you have a timing file you can share?

The grid and compset are the same as used in the previous runs. It seems to be a network probleam, and the speed returns to normal today. Attached is a low speed timing file.

 

[jedwards]

So it was a system issue, I'm glad that you found it.