Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Problem to run OpenMP/MPI hybrid on case ne120_t12

Hello there,I am trying to run CESm1.2.2.1 with case ne120_t12.I have lnd model uses 360 MPI tasks, ice 720, and ocn 360, then set OMP_NUM_THREADS=2.When I run it, I got error:  Warning: Departure points out of bounds in remap my_task, i, j =         541           5          19 dpx, dpy =  -26.2273426325629        5891.85314100767 HTN(i,j), HTN(i+1,j) =   3890.42157100753        3894.98816049952 HTE(i,j), HTE(i,j+1) =   3788.50188375742        3786.49589919537 istep1, my_task, iblk =           1         541           3 Global block:       10961 Global i and j:         404        2298(shr_sys_abort) ERROR: remap transport: bad departure points(shr_sys_abort) WARNING: calling shr_mpi_abort() and stoppingapplication called MPI_Abort(MPI_COMM_WORLD, 1001) - process 901  Warning: Departure points out of bounds in remap my_task, i, j =         627          26          20 dpx, dpy =   5653.99189425681        23.1312094799313 HTN(i,j), HTN(i+1,j) =   3553.09642109926        3558.88556378382 HTE(i,j), HTE(i,j+1) =   3347.88520022242        3346.32650895058 istep1, my_task, iblk =           1         627           4 Global block:       11102 Global i and j:         350        2329(shr_sys_abort) ERROR: remap transport: bad departure points(shr_sys_abort) WARNING: calling shr_mpi_abort() and stoppingapplication called MPI_Abort(MPI_COMM_WORLD, 1001) - process 987 It works fine with OMP_NUM_THREADS=1, and lnd 720, ice 1440, and ocn 720 cores. Could you please help me fix this problem? Thanks, Wei  
 
Actually, adjust the ice dynamics timestep sndt_dyn did not make much sens, as the code runs fine with OMP_NUM_THREADS=1.It is more related to some env. variable setup, not CFL valiation.
 
Top