Hello there, I am running fully coupled paleoclimate simulation (use B1850) with CESM1_2_2. The ocean tracer module is set to "iage ecosys" for this simulation. I used the initial field in the paleoclimate that I set up, and the model has worked successfully for 200 years. When I change to 'branch' continue to run the next 200 years, the run has failed within few seconds after I submit the job. The error message I got is mainly from ocean model.
Here is the last few lines from cesm.log:
1734 ------------------------------------------------------------------------
1735
1736 POP aborting...
1737 Error in getting varid for netCDF field
1738
1739 ------------------------------------------------------------------------
1740 ------------------------------------------------------------------------
1741
1742 POP aborting...
1743 Error in getting varid for netCDF field
1744
1745 ------------------------------------------------------------------------
1746 --------------------------------------------------------------------------
1747 MPI_ABORT was invoked on rank 22 in communicator MPI_COMM_WORLD
1748 with errorcode 0.
1749
1750 NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
1751 You may or may not see output from other processes, depending on
1752 exactly when Open MPI kills them.
1753 --------------------------------------------------------------------------
I also checked the pop.log file:
1531 ------------------------------------------------------------------------
1532 (passive_tracer_tools:rest_read_tracer_block) reading tracer block from /public/home/xdsc0718/work/paleo/INPUTTOPO_T31g37/66ma/T31_KT _boundary_ecosys_g37_20220531.nc
1533 (passive_tracer_tools:read_field_3D) reading PO4_CUR from /public/home/xdsc0718/work/paleo/INPUTTOPO_T31g37/66ma/T31_KT_boundary_ecos ys_g37_20220531.nc
1534 (open_read_netcdf) nsize = 603
1535 (open_read_netcdf) len(data_file%history) = 256
1536 string too short; not enough room to read history attribute from /public/home/x
1537 dsc0718/work/paleo/INPUTTOPO_T31g37/66ma/T31_KT_boundary_ecosys_g37_20220531.nc
------------------------------------------------------------------------
So I believe that this run fails because there is no variable "PO4_CUR " in the ocean initial condition file T31_KT_boundary_ecosys_g37_20220531.nc. So I was wondering if anyone has any solution or hint to this problem.
T31_kt_boundary_ecosys_g37_20220531.nc is the replacement file corresponding to palaeoclimate that I interpolated from the default file ECOsys_JAN_IC_Gx3V7_NOV2012_rode 2.nc. But the default file Ecosys_jan_ic_gx3v7_nov2012_cor.nc also does not have the variable 'PO4_CUR'. Now I don't know what went wrong, where to find the variable 'PO4_CUR'.
Attached is my error log file: pop.log and cesm.log.
I hope to get your help. I would really appreciate your help!
Best,Yihui
Here is the last few lines from cesm.log:
1734 ------------------------------------------------------------------------
1735
1736 POP aborting...
1737 Error in getting varid for netCDF field
1738
1739 ------------------------------------------------------------------------
1740 ------------------------------------------------------------------------
1741
1742 POP aborting...
1743 Error in getting varid for netCDF field
1744
1745 ------------------------------------------------------------------------
1746 --------------------------------------------------------------------------
1747 MPI_ABORT was invoked on rank 22 in communicator MPI_COMM_WORLD
1748 with errorcode 0.
1749
1750 NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
1751 You may or may not see output from other processes, depending on
1752 exactly when Open MPI kills them.
1753 --------------------------------------------------------------------------
I also checked the pop.log file:
1531 ------------------------------------------------------------------------
1532 (passive_tracer_tools:rest_read_tracer_block) reading tracer block from /public/home/xdsc0718/work/paleo/INPUTTOPO_T31g37/66ma/T31_KT _boundary_ecosys_g37_20220531.nc
1533 (passive_tracer_tools:read_field_3D) reading PO4_CUR from /public/home/xdsc0718/work/paleo/INPUTTOPO_T31g37/66ma/T31_KT_boundary_ecos ys_g37_20220531.nc
1534 (open_read_netcdf) nsize = 603
1535 (open_read_netcdf) len(data_file%history) = 256
1536 string too short; not enough room to read history attribute from /public/home/x
1537 dsc0718/work/paleo/INPUTTOPO_T31g37/66ma/T31_KT_boundary_ecosys_g37_20220531.nc
------------------------------------------------------------------------
So I believe that this run fails because there is no variable "PO4_CUR " in the ocean initial condition file T31_KT_boundary_ecosys_g37_20220531.nc. So I was wondering if anyone has any solution or hint to this problem.
T31_kt_boundary_ecosys_g37_20220531.nc is the replacement file corresponding to palaeoclimate that I interpolated from the default file ECOsys_JAN_IC_Gx3V7_NOV2012_rode 2.nc. But the default file Ecosys_jan_ic_gx3v7_nov2012_cor.nc also does not have the variable 'PO4_CUR'. Now I don't know what went wrong, where to find the variable 'PO4_CUR'.
Attached is my error log file: pop.log and cesm.log.
I hope to get your help. I would really appreciate your help!
Best,Yihui