CESM1_2_2 fails on Yellowstone with nthreads=4 for CAM

[jiangzhu]

Hello,I tried to set up a B case with CESM1_2_2 on Yellowstone using nthreads=4 for CAM, the model failed to run. The major error message in cesm.log file was "Fatal error in PMPI_Comm_create: Invalid group".Does anyone have any idea? In order to extend the scalability of CAM, is it true that we can increase the OpenMP threading? Any suggestion and comment are appreciated. Thank you so much.My steps on Yellowstone are as following:/glade/p/cesm/releases/cesm1_2_2/scripts/create_newcase -case test -res f19_g16 -compset B1850C5CN -mach yellowstone
cd test
./xmlchange NTASKS_ATM=960,NTHRDS_ATM=4,ROOTPE_ATM=0
./xmlchange NTASKS_CPL=960,NTHRDS_CPL=2,ROOTPE_CPL=0
./xmlchange NTASKS_ICE=640,NTHRDS_ICE=2,ROOTPE_ICE=0
./xmlchange NTASKS_LND=320,NTHRDS_LND=1,ROOTPE_LND=640
./xmlchange NTASKS_ROF=320,NTHRDS_ROF=1,ROOTPE_ROF=640
./xmlchange NTASKS_OCN=160,NTHRDS_OCN=1,ROOTPE_OCN=960
./cesm_setup
./*.build
./*.submit Best wishes,Jiang

 

[jedwards]

You need to set the number of threads for each component to be the same - that is if you want 4 threads in atm set them all to be 4.Yellowstone does not give good CESM performance when trying to use more that two threads, this is a known problem.   

 

[jedwards]

You need to set the number of threads for each component to be the same - that is if you want 4 threads in atm set them all to be 4.Yellowstone does not give good CESM performance when trying to use more that two threads, this is a known problem.