hbrown18@uwyo_edu
New Member
Hello,I am having trouble porting a later version of CESM 1.2 to Cheyenne. The troubles are occuring after following these recommended changes:- http://lab.fengxiao.info/2019/02/06/running-old-version-of-CESM-on-Cheyenne-NCAR.html- https://bb.cgd.ucar.edu/cesm-1221-cesmsetup-module-issue-cheyenneI am using the following modules in my env_mach_specific (which worked in the past with a similar version of CESM):intel/18.0.5, ncarenv/1.3, mkl/2018.0.5, ncarcompilers/0.5.0, mpt/2.19, netcdf/4.6.3, netcdf-mpi/4.6.3, pnetcdf/1.11.1 When I run the code with the recommended updated version of pio (1_8_14, https://bb.cgd.ucar.edu/cesm-1221-cesmsetup-module-issue-cheyenne) the model crashes at csm_share.bldlog with the error message:.../gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(720): error #6460: This is not a field name that is defined in the encompassing structure. [COMM_FC_OPTS] pio_rearr_opts%comm_fc_opts%fcd = buf(2)-------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(720): error #6460: This is not a field name that is defined in the encompassing structure. [FCD] pio_rearr_opts%comm_fc_opts%fcd = buf(2)--------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(721): error #6460: This is not a field name that is defined in the encompassing structure. [MAX_PEND_REQ] pio_rearr_opts%comm_fc_opts%max_pend_req = buf(3)--------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(723): error #6460: This is not a field name that is defined in the encompassing structure. [ENABLE_HS] pio_rearr_opts%comm_fc_opts%enable_hs = .false.----------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(723): error #6303: The assignment operation or the binary expression operation is invalid for the data types of the two operands. pio_rearr_opts%comm_fc_opts%enable_hs = .false.----------------------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(725): error #6303: The assignment operation or the binary expression operation is invalid for the data types of the two operands. pio_rearr_opts%comm_fc_opts%enable_hs = .true.----------------------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(728): error #6460: This is not a field name that is defined in the encompassing structure. [ENABLE_ISEND] pio_rearr_opts%comm_fc_opts%enable_isend = .false.----------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(728): error #6303: The assignment operation or the binary expression operation is invalid for the data types of the two operands. pio_rearr_opts%comm_fc_opts%enable_isend = .false.-------------------------------------------------^/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90(730): error #6303: The assignment operation or the binary expression operation is invalid for the data types of the two operands. pio_rearr_opts%comm_fc_opts%enable_isend = .true.-------------------------------------------------^compilation aborted for /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/csm_share/shr/shr_pio_mod.F90 (code 1)/glade/scratch/hbrown/port_test/cases/port_test2/Tools/Makefile:650: recipe for target 'shr_pio_mod.o' failedgmake: *** [shr_pio_mod.o] Error 1gmake: *** Waiting for unfinished jobs.... gmake complib -j 8 MODEL=csm_share COMPLIB=libcsm_share.a USER_CPPDEFS=" -DNUM_COMP_INST_ATM=1 -DNUM_COMP_INST_LND=1 -DNUM_COMP_INST_OCN=1 -DNUM_COMP_INST_ICE=1 -DNUM_COMP_INST_GLC=1 -DNUM_COMP_INST_WAV=1 -DNUM_COMP_INST_ROF=1" -f /glade/scratch/hbrown/port_test/cases/port_test2/Tools/Makefile returned non-zero exit status 2
When I leave the pio version as is (version 1_8_11), the model makes it further along in the build, but crashes at the cesm.bldlog with the error: ...mpif90 -o /glade/scratch/hbrown/port_test/port_test1/bld/cesm.exe ccsm_comp_mod.o ccsm_driver.o component_mod.o component_type_mod.o cpl_comp_esmf.o cplcomp_exchange_mod.o prep_aoflux_mod.o prep_atm_mod.o prep_glc_mod.o prep_ice_mod.o prep_lnd_mod.o prep_ocn_mod.o prep_rof_mod.o prep_wav_mod.o seq_diag_mct.o seq_domain_mct.o seq_flux_mct.o seq_frac_mct.o seq_hist_mod.o seq_io_mod.o seq_map_esmf.o seq_map_mod.o seq_map_type_mod.o seq_rest_mod.o t_driver_timers_mod.o -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -latm -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lice -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -llnd -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -locn -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lrof -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lglc -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lwav -L/glade/scratch/hbrown/port_test/port_test1/bld/intel/mpt/debug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share -lcsm_share -L/glade/scratch/hbrown/port_test/port_test1/bld/intel/mpt/debug/nothreads/lib -lpio -lgptl -lmct -lmpeu -L/glade/u/apps/ch/opt/netcdf-mpi/4.6.3/mpt/2.19/intel/18.0.5//lib -lnetcdf -L/glade/u/apps/ch/opt/pnetcdf/1.11.1/mpt/2.19/intel/18.0.5//lib -lpnetcdf/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: ccsm_comp_mod.o: in function `ccsm_comp_mod_mp_ccsm_pre_init1_':/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:550:(.text+0x2b): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_ierr_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:551:(.text+0x95): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_ierr_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:553:(.text+0xbf): relocation truncated to fit: R_X86_64_PC32 against symbol `ccsm_comp_mod_mp_global_comm_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:555:(.text+0x13d): relocation truncated to fit: R_X86_64_PC32 against symbol `ccsm_comp_mod_mp_time_brun_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:557:(.text+0x14c): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_global_comm_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:564:(.text+0x167): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_global_comm_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:567:(.text+0x188): relocation truncated to fit: R_X86_64_32 against symbol `seq_comm_mct_mp_gloid_' defined in COMMON section in /glade/scratch/hbrown/port_test/port_test1/bld/intel/mpt/debug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share/libcsm_share.a(seq_comm_mct.o)/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:567:(.text+0x1a1): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_iam_gloid_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:567:(.text+0x1d3): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_pethreads_gloid_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:568:(.text+0x226): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_pethreads_gloid_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:572:(.text+0x248): additional relocation overflows omitted from the output/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: failed to convert GOTPCREL relocation; relink with --no-relax/glade/scratch/hbrown/port_test/cases/port_test1/Tools/Makefile:636: recipe for target '/glade/scratch/hbrown/port_test/port_test1/bld/cesm.exe' failedgmake: *** [/glade/scratch/hbrown/port_test/port_test1/bld/cesm.exe] Error 1
Could this be an issue with the modules I have loaded? These were errors that I hadn't found in the discussions previously and wanted to see if anyone had any recommendations. Thanks for your time,
When I leave the pio version as is (version 1_8_11), the model makes it further along in the build, but crashes at the cesm.bldlog with the error: ...mpif90 -o /glade/scratch/hbrown/port_test/port_test1/bld/cesm.exe ccsm_comp_mod.o ccsm_driver.o component_mod.o component_type_mod.o cpl_comp_esmf.o cplcomp_exchange_mod.o prep_aoflux_mod.o prep_atm_mod.o prep_glc_mod.o prep_ice_mod.o prep_lnd_mod.o prep_ocn_mod.o prep_rof_mod.o prep_wav_mod.o seq_diag_mct.o seq_domain_mct.o seq_flux_mct.o seq_frac_mct.o seq_hist_mod.o seq_io_mod.o seq_map_esmf.o seq_map_mod.o seq_map_type_mod.o seq_rest_mod.o t_driver_timers_mod.o -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -latm -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lice -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -llnd -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -locn -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lrof -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lglc -L/glade/scratch/hbrown/port_test/port_test1/bld/lib/ -lwav -L/glade/scratch/hbrown/port_test/port_test1/bld/intel/mpt/debug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share -lcsm_share -L/glade/scratch/hbrown/port_test/port_test1/bld/intel/mpt/debug/nothreads/lib -lpio -lgptl -lmct -lmpeu -L/glade/u/apps/ch/opt/netcdf-mpi/4.6.3/mpt/2.19/intel/18.0.5//lib -lnetcdf -L/glade/u/apps/ch/opt/pnetcdf/1.11.1/mpt/2.19/intel/18.0.5//lib -lpnetcdf/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: ccsm_comp_mod.o: in function `ccsm_comp_mod_mp_ccsm_pre_init1_':/gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:550:(.text+0x2b): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_ierr_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:551:(.text+0x95): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_ierr_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:553:(.text+0xbf): relocation truncated to fit: R_X86_64_PC32 against symbol `ccsm_comp_mod_mp_global_comm_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:555:(.text+0x13d): relocation truncated to fit: R_X86_64_PC32 against symbol `ccsm_comp_mod_mp_time_brun_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:557:(.text+0x14c): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_global_comm_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:564:(.text+0x167): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_global_comm_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:567:(.text+0x188): relocation truncated to fit: R_X86_64_32 against symbol `seq_comm_mct_mp_gloid_' defined in COMMON section in /glade/scratch/hbrown/port_test/port_test1/bld/intel/mpt/debug/nothreads/MCT/noesmf/a1l1r1i1o1g1w1/csm_share/libcsm_share.a(seq_comm_mct.o)/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:567:(.text+0x1a1): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_iam_gloid_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:567:(.text+0x1d3): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_pethreads_gloid_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:568:(.text+0x226): relocation truncated to fit: R_X86_64_32 against symbol `ccsm_comp_mod_mp_pethreads_gloid_' defined in COMMON section in ccsm_comp_mod.o/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: /gpfs/fs1/work/hbrown/PNNL/cesm/CAM5-MAM4_trk/cheyenne_code/ACME-hilat_hw_tag_BC_8_MAM4/models/drv/driver/ccsm_comp_mod.F90:572:(.text+0x248): additional relocation overflows omitted from the output/usr/lib64/gcc/x86_64-suse-linux/4.8/../../../../x86_64-suse-linux/bin/ld: failed to convert GOTPCREL relocation; relink with --no-relax/glade/scratch/hbrown/port_test/cases/port_test1/Tools/Makefile:636: recipe for target '/glade/scratch/hbrown/port_test/port_test1/bld/cesm.exe' failedgmake: *** [/glade/scratch/hbrown/port_test/port_test1/bld/cesm.exe] Error 1
Could this be an issue with the modules I have loaded? These were errors that I hadn't found in the discussions previously and wanted to see if anyone had any recommendations. Thanks for your time,