Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

CESM2.3.beta08 porting issue

inos@bas_ac_uk

Ingrid Cnossen
Member
Hi Inos,

I have ported CESM3 in archer2. Please goto ccs_config/machines/cmake_macros and create a new file named gnu_archer2.cmake. Below are my scripts for your reference.

set(HDF5_DIR "/opt/cray/pe/hdf5-parallel/1.12.2.1/gnu/9.1")
set(NETCDF_C_PATH "/opt/cray/pe/netcdf-hdf5parallel/4.9.0.1/gnu/9.1")
set(NETCDF_FORTRAN_PATH "/opt/cray/pe/netcdf-hdf5parallel/4.9.0.1/gnu/9.1")
set(ESMF_LIBDIR "/mnt/lustre/a2fs-work2/work/n02/n02/yuansun/privatemodules_packages/archer2/apps/gcc/esmf/8.6/lib")
set(PIO_LIBDIR "/mnt/lustre/a2fs-work2/work/n02/n02/yuansun/privatemodules_packages/archer2/apps/gcc/pio2/2.6.2/lib")
string(APPEND SLIBS " -L$ENV{HDF5_PATH}/lib -lhdf5_fortran -lhdf5 -lhdf5_hl -lhdf5hl_fortran -Wl,-rpath,${HDF5_PATH}/lib")
string(APPEND SLIBS " -L${NETCDF_C_PATH}/lib -L${NETCDF_FORTRAN_PATH}/lib -lnetcdff -lnetcdf -lm")
string(APPEND SLIBS " -L${PIO_LIBDIR} -Wl,-rpath,${PIO_LIBDIR} -ldl")
string(APPEND SLIBS " -L${ESMF_LIBDIR} -Wl,-rpath,${ESMF_LIBDIR} -ldl")

Best,
Yuan
Hi Yuan,

I thought I'd try building the code with your ESMF library to see if that would help. However, I do not have permission. Are you able to provide this? I'm also considering to just upgrade to CESM3, as it might end up being a quicker solution, even if I have to redo some additional simulations. So I guess I'd need permission in that case too. By the way, if it's easier, we could talk about this via e-mail. You can reach me on inos AT bas.ac.uk.

Thanks,
Ingrid
 

Yuan Sun

Yuan Sun
Member
Hi Yuan,

I thought I'd try building the code with your ESMF library to see if that would help. However, I do not have permission. Are you able to provide this? I'm also considering to just upgrade to CESM3, as it might end up being a quicker solution, even if I have to redo some additional simulations. So I guess I'd need permission in that case too. By the way, if it's easier, we could talk about this via e-mail. You can reach me on inos AT bas.ac.uk.

Thanks,
Ingrid
Hi Ingrid,

You can not visit my archer2 work directory. Two solutions:

1) Follow the archer2's guidance to install cesm2.1.3. I have uploaded three configuration files. You can copy them into your work directory.

2) If you decide to transfer to cesm2.3 or cesm3, you need to install PIO and ESMF, and/or other libraries in your private directory to support high versions.

I prefer to discuss here so that other users may learn from the discussion.

Gook luck,
Yuan
 

inos@bas_ac_uk

Ingrid Cnossen
Member
Hi Ingrid,

You can not visit my archer2 work directory. Two solutions:

1) Follow the archer2's guidance to install cesm2.1.3. I have uploaded three configuration files. You can copy them into your work directory.

2) If you decide to transfer to cesm2.3 or cesm3, you need to install PIO and ESMF, and/or other libraries in your private directory to support high versions.

I prefer to discuss here so that other users may learn from the discussion.

Gook luck,
Yuan
Hi Yuan,

Sure, I understand. We can continue here.

I would prefer option 1. However, I have followed all the instructions and I have tried replacing the configuration files with yours, but this does not solve the problem. I still get the same error, where the code is trying to access a netcdf library that is no longer there:

work/n02/n02/inos/cesm/CESM2.1.3/runs/f.e213.FXHIST.f19_f19.WXAug2018t/bld/cesm.exe: error while loading shared libraries: libnetcdf_parallel_gnu_91.so.18: cannot open shared object file: No such file or directory

This happens even when I set up a new case directory from scratch (I tested that to make sure there wasn't something lingering from when I originally set the case up 2 years ago). I don't know how to move past this; I just have some vague ideas and I'm struggling to test them. For example, I wonder if it could be related to the ESMF library. Does this make use of the netcdf library? If so, then perhaps the issue is arising from the existing ESMF library on Archer2 having been built with an older version of the NetCDF library that is now no longer there. Or maybe ESMF doesn't rely on netcdf. Maybe it's another previously built library that depends on an older version of the netcdf module. Or something else, I'm not sure. Any thoughts?

If I can't solve the issue through option 1, then I think I'll try CESM 2.3 actually rather than CESM3 (as I see CESM3 has not been released yet), and I will try to install my own PIO and ESMF libraries. Or I might just try and do this part first and see if I can get CESM2.1.3 to run with my own ESMF library. But I'll leave that for 2025 :-)

Merry Christmas!

Ingrid
 

jedwards

CSEG and Liaisons
Staff member
Hi Ingrid, I would strongly encourage you to use a cesm3 prerelease rather than cesm2.2. Although cesm2.2 is a released version it is an orphan with no further development planned. Using cesm3 gives you a path to move forward as development continues.
 
Top