You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an alternative browser.
You should upgrade or use an alternative browser.
cesm1.1.1 build pio question
- Thread starter yunqian_zhu@colorado_edu
- Start date
mark@atmos_colostate_edu
Member
That fixed it! pio now compiles as does the full model. Thanks for your help with this, Jim!
mark@atmos_colostate_edu
Member
I have something odd to report. I ran the code with this new pio library for almost a simulated year. This is an older version of SP-CAM, and I have daily history file output turned on as well as the standard monthly mean history files. For some reason all of the 3D fields that I look at in the monthly mean h0 files are all goofy. The numbers are non-physical. But the 2D fields seem quite reasonable. At first I thought I must have initialized it incorrectly, but then I checked the 3D fields in the h1 history files and they all look reasonable. Is there any chance the new pio library is causing this? If you want to take a look, the output files are in /glade/scratch/branson/spcam_nlev53/run.
I don't think that the pio library would cause this if the h1 files look okay. You can also try https://github.com/NCAR/ParallelIO.git/tags/pio1_7_3/pio I've confirmed that it works with your model version, but I don't think it'll make any difference.
mark@atmos_colostate_edu
Member
I can't get pio1_7_3 to compile successfully. The Makefile assumes that genf90.pl is located in ../bin but I have no such directory, so I copied genf90.pl over from the other pio version and modified GENF90 in the Makefile, but it's got other problems. Here's the pio bldlog:Wed Apr 10 15:38:00 MDT 2019 /glade/scratch/branson/spcam_nlev53/bld/pio/pio.bldlog.190410-153752Copying source to CCSM EXEROOT...PIO already built. Checking machine typeSame machine.Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 --> pio.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 > pio.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 --> pio_kinds.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 > pio_kinds.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 --> nf_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 > nf_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 --> ionf_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 > ionf_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 --> pio_types.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 > pio_types.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 --> calcdecomp.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 > calcdecomp.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 --> piolib_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 > piolib_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 --> pio_mpi_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 > pio_mpi_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 --> pio_nf_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 > pio_nf_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 --> pio_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 > pio_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 --> pio_msg_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 > pio_msg_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 --> calcdisplace_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 > calcdisplace_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 --> pio_msg_callbacks.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 > pio_msg_callbacks.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 --> pio_support.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 > pio_support.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 --> C_interface_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 > C_interface_mod.dMaking dependencies for pionfatt_mod.F90 --> pionfatt_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfatt_mod -v SUF=.F90 pionfatt_mod.F90 > pionfatt_mod.dMaking dependencies for pionfread_mod.F90 --> pionfread_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfread_mod -v SUF=.F90 pionfread_mod.F90 > pionfread_mod.dMaking dependencies for pionfwrite_mod.F90 --> pionfwrite_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfwrite_mod -v SUF=.F90 pionfwrite_mod.F90 > pionfwrite_mod.dMaking dependencies for pionfput_mod.F90 --> pionfput_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfput_mod -v SUF=.F90 pionfput_mod.F90 > pionfput_mod.dMaking dependencies for pionfget_mod.F90 --> pionfget_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfget_mod -v SUF=.F90 pionfget_mod.F90 > pionfget_mod.d/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/alloc_mod.F90.in > alloc_mod.F90Making dependencies for alloc_mod.F90 --> alloc_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=alloc_mod -v SUF=.F90 alloc_mod.F90 > alloc_mod.d/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/box_rearrange.F90.in > box_rearrange.F90Making dependencies for box_rearrange.F90 --> box_rearrange.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=box_rearrange -v SUF=.F90 box_rearrange.F90 > box_rearrange.d/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/rearrange.F90.in > rearrange.F90Making dependencies for rearrange.F90 --> rearrange.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=rearrange -v SUF=.F90 rearrange.F90 > rearrange.d/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/iompi_mod.F90.in > iompi_mod.F90Making dependencies for iompi_mod.F90 --> iompi_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=iompi_mod -v SUF=.F90 iompi_mod.F90 > iompi_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 --> piodarray.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 > piodarray.d/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_spmd_utils.F90.in > pio_spmd_utils.F90Making dependencies for pio_spmd_utils.F90 --> pio_spmd_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_spmd_utils -v SUF=.F90 pio_spmd_utils.F90 > pio_spmd_utils.d/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_getput_callbacks.F90.in > pio_msg_getput_callbacks.F90Making dependencies for pio_msg_getput_callbacks.F90 --> pio_msg_getput_callbacks.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_msg_getput_callbacks -v SUF=.F90 pio_msg_getput_callbacks.F90 > pio_msg_getput_callbacks.dDone updating dependenciesgmake[1]: Entering directory '/gpfs/fs1/scratch/branson/spcam_nlev53/bld/pio'Makefile:157: pio.d: No such file or directoryMakefile:157: pio_kinds.d: No such file or directoryMakefile:157: nf_mod.d: No such file or directoryMakefile:157: ionf_mod.d: No such file or directoryMakefile:157: pio_types.d: No such file or directoryMakefile:157: calcdecomp.d: No such file or directoryMakefile:157: piolib_mod.d: No such file or directoryMakefile:157: pio_mpi_utils.d: No such file or directoryMakefile:157: pio_nf_utils.d: No such file or directoryMakefile:157: pio_utils.d: No such file or directoryMakefile:157: pio_msg_mod.d: No such file or directoryMakefile:157: calcdisplace_mod.d: No such file or directoryMakefile:157: pio_msg_callbacks.d: No such file or directoryMakefile:157: pio_support.d: No such file or directoryMakefile:157: C_interface_mod.d: No such file or directoryMakefile:157: pionfatt_mod.d: No such file or directoryMakefile:157: pionfread_mod.d: No such file or directoryMakefile:157: pionfwrite_mod.d: No such file or directoryMakefile:157: pionfput_mod.d: No such file or directoryMakefile:157: pionfget_mod.d: No such file or directoryMakefile:157: alloc_mod.d: No such file or directoryMakefile:157: box_rearrange.d: No such file or directoryMakefile:157: rearrange.d: No such file or directoryMakefile:157: iompi_mod.d: No such file or directoryMakefile:157: piodarray.d: No such file or directoryMakefile:157: pio_spmd_utils.d: No such file or directoryMakefile:157: pio_msg_getput_callbacks.d: No such file or directoryMaking dependencies for pio_msg_getput_callbacks.F90 --> pio_msg_getput_callbacks.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_msg_getput_callbacks -v SUF=.F90 pio_msg_getput_callbacks.F90 > pio_msg_getput_callbacks.dMaking dependencies for pio_spmd_utils.F90 --> pio_spmd_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_spmd_utils -v SUF=.F90 pio_spmd_utils.F90 > pio_spmd_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 --> piodarray.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 > piodarray.dMaking dependencies for iompi_mod.F90 --> iompi_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=iompi_mod -v SUF=.F90 iompi_mod.F90 > iompi_mod.dMaking dependencies for rearrange.F90 --> rearrange.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=rearrange -v SUF=.F90 rearrange.F90 > rearrange.dMaking dependencies for box_rearrange.F90 --> box_rearrange.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=box_rearrange -v SUF=.F90 box_rearrange.F90 > box_rearrange.dMaking dependencies for alloc_mod.F90 --> alloc_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=alloc_mod -v SUF=.F90 alloc_mod.F90 > alloc_mod.dMaking dependencies for pionfget_mod.F90 --> pionfget_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfget_mod -v SUF=.F90 pionfget_mod.F90 > pionfget_mod.dMaking dependencies for pionfput_mod.F90 --> pionfput_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfput_mod -v SUF=.F90 pionfput_mod.F90 > pionfput_mod.dMaking dependencies for pionfwrite_mod.F90 --> pionfwrite_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfwrite_mod -v SUF=.F90 pionfwrite_mod.F90 > pionfwrite_mod.dMaking dependencies for pionfread_mod.F90 --> pionfread_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfread_mod -v SUF=.F90 pionfread_mod.F90 > pionfread_mod.dMaking dependencies for pionfatt_mod.F90 --> pionfatt_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfatt_mod -v SUF=.F90 pionfatt_mod.F90 > pionfatt_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 --> C_interface_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 > C_interface_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 --> pio_support.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 > pio_support.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 --> pio_msg_callbacks.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 > pio_msg_callbacks.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 --> calcdisplace_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 > calcdisplace_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 --> pio_msg_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 > pio_msg_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 --> pio_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 > pio_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 --> pio_nf_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 > pio_nf_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 --> pio_mpi_utils.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 > pio_mpi_utils.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 --> piolib_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 > piolib_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 --> calcdecomp.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 > calcdecomp.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 --> pio_types.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 > pio_types.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 --> ionf_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 > ionf_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 --> nf_mod.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 > nf_mod.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 --> pio_kinds.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 > pio_kinds.dMaking dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 --> pio.d#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 > pio.dmpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing alloc_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing iompi_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing pio_spmd_utils.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing box_rearrange.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing rearrange.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing pionfwrite_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing pionfread_mod.F90mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback -free -I. -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(20): error #7002: Error in opening the compiled module file. Check INCLUDE paths. [PIONFWRITE_MOD] use pionfwrite_mod, only : write_nf------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(21): error #7002: Error in opening the compiled module file. Check INCLUDE paths. [PIONFREAD_MOD] use pionfread_mod, only : read_nf------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(20): error #6580: Name in only-list does not exist. [WRITE_NF] use pionfwrite_mod, only : write_nf-----------------------------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(21): error #6580: Name in only-list does not exist. [READ_NF] use pionfread_mod, only : read_nf----------------------------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(603): error #6404: This name does not have a type, and must have an explicit type. [WRITE_NF] ierr = write_nf(File,IOBUF,varDesc,iodesc,start,count, request) -----------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(603): error #6406: Conflicting attributes or multiple declaration of name. [WRITE_NF] ierr = write_nf(File,IOBUF,varDesc,iodesc,start,count, request) -----------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(603): error #6406: Conflicting attributes or multiple declaration of name. [WRITE_NF] ierr = write_nf(File,IOBUF,varDesc,iodesc,start,count, request) -----------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(947): error #6404: This name does not have a type, and must have an explicit type. [READ_NF] ierr = read_nf(File,IOBUF,varDesc,iodesc,start(1:ndims),count(1:ndims))-----------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(947): error #6406: Conflicting attributes or multiple declaration of name. [READ_NF] ierr = read_nf(File,IOBUF,varDesc,iodesc,start(1:ndims),count(1:ndims))-----------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(947): error #6406: Conflicting attributes or multiple declaration of name. [READ_NF] ierr = read_nf(File,IOBUF,varDesc,iodesc,start(1:ndims),count(1:ndims))-----------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1199): error #6460: This is not a field name that is defined in the encompassing structure. [REQUEST_CNT] File%request_cnt=File%request_cnt+1---------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8). [REQUEST_CNT] allocate(array_of_requests(file%request_cnt), status(file%request_cnt))---------------------------------------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8). [REQUEST_CNT] allocate(array_of_requests(file%request_cnt), status(file%request_cnt))-----------------------------------------------------------------^compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)Makefile:116: recipe for target 'piodarray.o' failedgmake[1]: *** [piodarray.o] Error 1gmake[1]: Leaving directory '/gpfs/fs1/scratch/branson/spcam_nlev53/bld/pio'Makefile:89: recipe for target 'all' failedgmake: *** [all] Error 2
mark@atmos_colostate_edu
Member
Okay, I removed my build directory and started over. This time I got these errors in the pio bld log file:/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1199): error #6460: This is not a field name that is defined in the encompassing structure. [REQUEST_CNT] File%request_cnt=File%request_cnt+1---------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8). [REQUEST_CNT] allocate(array_of_requests(file%request_cnt), status(file%request_cnt))---------------------------------------^/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8). [REQUEST_CNT] allocate(array_of_requests(file%request_cnt), status(file%request_cnt))-----------------------------------------------------------------^compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)-----------------------------------------------------------------^compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)Makefile:116: recipe for target 'piodarray.o' failedgmake[1]: *** [piodarray.o] Error 1gmake[1]: Leaving directory '/gpfs/fs1/scratch/branson/spcam_nlev53/bld/pio'Makefile:89: recipe for target 'all' failedgmake: *** [all] Error 2
try https://github.com/NCAR/ParallelIO.git/tags/pio1_7_4/pio but again - I don't think your history file issue is a pio problem.
mark@atmos_colostate_edu
Member
Well, I tried pio1_7_4 and not only did it compile successfully without any complications, but the 3D fields in the January monthly mean history file all look normal again. So I'm glad I tried it. :)
mark@atmos_colostate_edu
Member
Well, for better or worse you were actually right. I'm still getting messed up h0 files. I was initially fooled because after I recompiled the model with pio1_7_4 it ran several months with perfectly fine h0 history files, but then every other one had corrupted 3D fields. And, just as before, the very same fields (temperature, zonal wind, water vapor mixing ratio) look correct in the daily mean h1 history files. I also just tried recompiling a standard CAM case from the same code base, and in a 1-year test only one h0 file was messed up. I was wondering if somehow the problem would only happen in an SP case, but apparently not. I'm at a loss as to how to proceed from here in trying to debug this. If you have any suggestions, I'm all ears.Mark
jmnicklas@gmail_com
New Member
Hello,I am trying to re-port CESM 1.1.2 onto the newly updated cheyenne. I previously got it to work using the mpitch2 libraries, but these are now gone. I have managed to get all the way through build steps, but the model terminates in a very strange way in the atm model without leaving any explanation.Here's my setup (at /glade/u/home/jnicklas/cases/b.devel3.B20TR):env_build.xml
Macros (I know some of this is extraneous) CPPDEFS+= -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTELCFLAGS:= -O2 -fp-model precise -xHostFC_AUTO_R8:= -r8FFLAGS:= -fp-model source -convert big_endian -assume byterecl -ftz -traceback -mcmodel medium -xHostFFLAGS_NOOPT:= -O0FIXEDFLAGS:= -fixed -132FREEFLAGS:= -freeMPICC:=mpiccMPIFC:=mpif90NETCDF_PATH:=$(NETCDF)PIO_CONFIG_OPTS:=PNETCDF_PATH:=$(PNETCDF)SCC:=iccSFC:=ifortifeq ($(compile_threaded), true) FFLAGS += -qopenmp CFLAGS += -qopenmp LDFLAGS += -qopenmpendififeq ($(MPILIB), mpich2) ifeq ($(MODEL), cam) CPPDEFS += -DNO_MPI2 endifendififeq ($(DEBUG), TRUE) FFLAGS += -O0 -g -CU -check pointers -fpe0 -ftzendififeq ($(DEBUG), FALSE) FFLAGS += -O2endif env_mach_specific #! /bin/csh -f source /glade/u/apps/ch/opt/lmod/8.1.7/lmod/lmod/init/csh module purgemodule load intel/18.0.5module load ncarenv/1.3#module load ncomodule load mklmodule load ncarcompilers/0.5.0module load mpt/2.19#module listif($MPILIB=="mpi-serial")then module load netcdf/4.6.3else module load netcdf-mpi/4.6.3 module load pnetcdf/1.11.1endif I think the problem may be somewhere in my run script: b.devel2.B20TR.run#!/bin/csh -f#PBS -A ubrn0013#PBS -N b.devel3.B20TR#PBS -q regular#PBS -l select=1:ncpus=36:mpiprocs=9:ompthreads=4#PBS -l walltime=04:00:00 #PBS -j oe#PBS -S /bin/csh -V # ---------------------------------------- # PE LAYOUT: # total number of tasks = 8 # maximum threads per task = 4 # cpl ntasks=8 nthreads=4 rootpe= 0 ninst=1 # cam ntasks=8 nthreads=4 rootpe= 0 ninst=1 # clm ntasks=8 nthreads=4 rootpe= 0 ninst=1 # cice ntasks=5 nthreads=4 rootpe= 0 ninst=1 # pop2 ntasks=4 nthreads= 1 rootpe= 0 ninst=1 # sglc ntasks=8 nthreads=4 rootpe= 0 ninst=1 # rtm ntasks=8 nthreads=4 rootpe= 0 ninst=1 # # total number of hw pes = 34 # cpl hw pe range ~ from 0 to 31 # cam hw pe range ~ from 0 to 31 # clm hw pe range ~ from 0 to 31 # cice hw pe range ~ from 0 to 19 # pop2 hw pe range ~ from 0 to 12 # sglc hw pe range ~ from 0 to 31 # rtm hw pe range ~ from 0 to 31 # ---------------------------------------- ...sleep 5cd $RUNDIRecho "`date` -- CSM EXECUTION BEGINS HERE" setenv OMP_NUM_THREADS 4# -p "|--%g of %G on %@-->"mpiexec_mpt $EXEROOT/cesm.exe >&! cesm.log.$LIDwait
There are no obvious errors in the run files:cpl.log(seq_mct_drv) : Initialize each component: atm, lnd, rof, ocn, ice, and glc(seq_mct_drv) : Initialize atm component ATMatm.log Warning: Not reading num_a3 from IC file. num_a3 initialized by "chem_init_cnst" Warning: Not reading num_a3 from IC file. num_a3 initialized by "chem_init_cnst" PROCESS_INIDAT: Will filter input PHIS: attribute from_hires is true ************************************************************************ INIDAT: Mass of initial data before correction = 1.0039638494E+04 Dry mass will be held at = 1.0016357065E+04 Mass of moisture after removal of negatives = 2.3418014947E+01INIDAT: Globally averaged geopotential height = 231.3831488948 meters ************************************************************************ print_energy_errors is set F Creating new decomp: 260500480096
Thank you very much in helping me understand what is going wrong.
Macros (I know some of this is extraneous) CPPDEFS+= -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTELCFLAGS:= -O2 -fp-model precise -xHostFC_AUTO_R8:= -r8FFLAGS:= -fp-model source -convert big_endian -assume byterecl -ftz -traceback -mcmodel medium -xHostFFLAGS_NOOPT:= -O0FIXEDFLAGS:= -fixed -132FREEFLAGS:= -freeMPICC:=mpiccMPIFC:=mpif90NETCDF_PATH:=$(NETCDF)PIO_CONFIG_OPTS:=PNETCDF_PATH:=$(PNETCDF)SCC:=iccSFC:=ifortifeq ($(compile_threaded), true) FFLAGS += -qopenmp CFLAGS += -qopenmp LDFLAGS += -qopenmpendififeq ($(MPILIB), mpich2) ifeq ($(MODEL), cam) CPPDEFS += -DNO_MPI2 endifendififeq ($(DEBUG), TRUE) FFLAGS += -O0 -g -CU -check pointers -fpe0 -ftzendififeq ($(DEBUG), FALSE) FFLAGS += -O2endif env_mach_specific #! /bin/csh -f source /glade/u/apps/ch/opt/lmod/8.1.7/lmod/lmod/init/csh module purgemodule load intel/18.0.5module load ncarenv/1.3#module load ncomodule load mklmodule load ncarcompilers/0.5.0module load mpt/2.19#module listif($MPILIB=="mpi-serial")then module load netcdf/4.6.3else module load netcdf-mpi/4.6.3 module load pnetcdf/1.11.1endif I think the problem may be somewhere in my run script: b.devel2.B20TR.run#!/bin/csh -f#PBS -A ubrn0013#PBS -N b.devel3.B20TR#PBS -q regular#PBS -l select=1:ncpus=36:mpiprocs=9:ompthreads=4#PBS -l walltime=04:00:00 #PBS -j oe#PBS -S /bin/csh -V # ---------------------------------------- # PE LAYOUT: # total number of tasks = 8 # maximum threads per task = 4 # cpl ntasks=8 nthreads=4 rootpe= 0 ninst=1 # cam ntasks=8 nthreads=4 rootpe= 0 ninst=1 # clm ntasks=8 nthreads=4 rootpe= 0 ninst=1 # cice ntasks=5 nthreads=4 rootpe= 0 ninst=1 # pop2 ntasks=4 nthreads= 1 rootpe= 0 ninst=1 # sglc ntasks=8 nthreads=4 rootpe= 0 ninst=1 # rtm ntasks=8 nthreads=4 rootpe= 0 ninst=1 # # total number of hw pes = 34 # cpl hw pe range ~ from 0 to 31 # cam hw pe range ~ from 0 to 31 # clm hw pe range ~ from 0 to 31 # cice hw pe range ~ from 0 to 19 # pop2 hw pe range ~ from 0 to 12 # sglc hw pe range ~ from 0 to 31 # rtm hw pe range ~ from 0 to 31 # ---------------------------------------- ...sleep 5cd $RUNDIRecho "`date` -- CSM EXECUTION BEGINS HERE" setenv OMP_NUM_THREADS 4# -p "|--%g of %G on %@-->"mpiexec_mpt $EXEROOT/cesm.exe >&! cesm.log.$LIDwait
There are no obvious errors in the run files:cpl.log(seq_mct_drv) : Initialize each component: atm, lnd, rof, ocn, ice, and glc(seq_mct_drv) : Initialize atm component ATMatm.log Warning: Not reading num_a3 from IC file. num_a3 initialized by "chem_init_cnst" Warning: Not reading num_a3 from IC file. num_a3 initialized by "chem_init_cnst" PROCESS_INIDAT: Will filter input PHIS: attribute from_hires is true ************************************************************************ INIDAT: Mass of initial data before correction = 1.0039638494E+04 Dry mass will be held at = 1.0016357065E+04 Mass of moisture after removal of negatives = 2.3418014947E+01INIDAT: Globally averaged geopotential height = 231.3831488948 meters ************************************************************************ print_energy_errors is set F Creating new decomp: 260500480096
Thank you very much in helping me understand what is going wrong.