PE layout for B1850 @ f19_g17 resolution on derecho

[JCC]

I'm wondering if anyone has tried a different PE layout for the CESM2.1.X B1850 compset at f19_g17 resolution than the default on derecho?
The default layout is copied below, and it does ~15 seconds per model day. I'm trying to get a configuration that runs a bit faster (~10 seconds/day).
Thanks in advance.

----

component comp_pes root_pe tasks x threads instances (stride)
--------- ------ ------- ------ ------ --------- ------
cpl = cpl 512 0 512 x 1 1 (1 )
atm = cam 512 0 512 x 1 1 (1 )
lnd = clm 256 0 256 x 1 1 (1 )
ice = cice 128 256 128 x 1 1 (1 )
ocn = pop 256 512 256 x 1 1 (1 )
rof = mosart 256 0 256 x 1 1 (1 )
glc = cism 128 0 128 x 1 1 (1 )
wav = ww 128 0 128 x 1 1 (1 )
esp = sesp 1 0 1 x 1 1 (1 )

total pes active : 768
mpi tasks per node : 128
pe count for cost estimate : 768

 

[jedwards]

./pelayout
Comp NTASKS NTHRDS ROOTPE
CPL : 1024/ 1; 0
ATM : 1024/ 1; 0
LND : 384/ 1; 0
ICE : 640/ 1; 384
OCN : 1024/ 1; 1024
ROF : 384/ 1; 0
GLC : 64/ 1; 0
WAV : 64/ 1; 64
ESP : 1/ 1; 0


Model Cost: 1264.25 pe-hrs/simulated_year
Model Throughput: 38.88 simulated_years/day

 

[JCC]

Thank you! I'll give it a try.

 

[yongsheng zheng]

./pelayout
Comp NTASKS NTHRDS ROOTPE
CPL : 1024/ 1; 0
ATM : 1024/ 1; 0
LND : 384/ 1; 0
ICE : 640/ 1; 384
OCN : 1024/ 1; 1024
ROF : 384/ 1; 0
GLC : 64/ 1; 0
WAV : 64/ 1; 64
ESP : 1/ 1; 0


Model Cost: 1264.25 pe-hrs/simulated_year
Model Throughput: 38.88 simulated_years/day

Hi jedwards,
When I was carrying out your PE layout, the following errors occurred. What is the reason? But NTASKS is set in multiples of 64 per module and runs.
The error message is as follows:
[zhengys@login03 4]$ ./cesm_setup
Creating Macros file for sugon
/work/home/zhengys/software/cesm1_2_2/scripts/ccsm_utils/Machines/config_compilers.xml intel sugon
Creating batch script 4.run
Locking file env_mach_pes.xml
Running preview_namelist script
infile is /work/home/zhengys/software/cesm1_2_2/scripts/4/Buildconf/cplconf/cesm_namelist
CAM build-namelist - ERROR: fv_decomp_set failed to find a decomposition.
npr_yz needs to be set by the user. at /work/home/zhengys/software/cesm1_2_2/models/atm/cam/bld/build-namelist line 3484.
ERROR: cam.buildnml.csh failed
ERROR: /work/home/zhengys/software/cesm1_2_2/scripts/4/preview_namelists failed: 25344