Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Using more nodes than I expect

Hi all,I am using a BWCN compset with total pes of 352 on yellowstone. I have set pes per node to 16, thus I expect to be using 22 nodes. However, I keep getting 44 nodes. I am not using multi-threading. Also, the variable COST_PES is set to 704 automatically, which seems to be double of what I would have expected. I am pasting my env_mach_pes.xml file below. Thanks for any help/advice!
-Ethan 






























































 

jedwards

CSEG and Liaisons
Staff member
Everything looks okay in this file except for the ROOTPE_LND which shoud be 0 to avoid overlap with the ice model.If you send me a pointer to your case directory on yellowstone I can take a closer look.
 

jedwards

CSEG and Liaisons
Staff member
In your run script the line: #BSUB -R "span[ptile=8]"controls the number of mpi tasks per node.   If you change that to 16, you will run on the correct number of nodes.  
We have found that using 15 tasks per node on yellowstone is generally faster than 16 tasks per node for CESM and I think that in implementing the 15 tpn setup we introduced a bug for 16 tpn.  
 
Top