Main menu

Navigation

cesm1.1.1 build pio question

32 posts / 0 new
Last post
yunqian.zhu@...
cesm1.1.1 build pio question

Hello,

I'm using cesm1.1.1, what kind of setting should I use? I tried pio mentioned for cesm1.1.2 and cesm1.2.2.1, but they don't work.

my env_mach_specific is:

module load intel/17.0.1

module load ncarenv/1.0

module load mkl

module load ncarcompilers/0.3.5

module load mpt/2.19

if($MPILIB== "mpi-serial" ) then

  module load netcdf/4.4.1.1

else

  module load netcdf-mpi/4.4.1.1

 

  module load pnetcdf/1.8.0

 

The error message shows when I build the model:

/usr/bin/perl ../bin/genf90.pl /gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio/pionfatt_mod.F90.in > pionfatt_mod.F90

Can't open perl script "../bin/genf90.pl": No such file or directory

Makefile:125: recipe for target 'pionfatt_mod.F90' failed

 

gmake: *** [pionfatt_mod.F90] Error 2

 

Thanks!

jedwards

CESM Software Engineer

yunqian.zhu@...

Thank you for the quick reply. But it seems the link is not working:

svn co http://parallelio.googlecode.com/svn/trunk_tags/pio1_5_9/pio/ 

svn: E160013: Unable to connect to a repository at URL 'http://parallelio.googlecode.com/svn/trunk_tags/pio1_5_9/pio'

svn: E160013: '/svn/trunk_tags/pio1_5_9/pio' path not found

Thanks,

jedwards

CESM Software Engineer

yunqian.zhu@...

Hello,

Thank you. But it is still not working and showing the same pio error message. The actual folder of my cesm1.1.1 is: cesm1_1_1_ccmi34/. It might make a difference since it is ccmi version of cesm1.1.1?


Thanks,

jedwards

I think I see the problem, do this and try again:

cp /gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio/genf90.pl  /gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/

CESM Software Engineer

yunqian.zhu@...

Hello,

They are the same folder. Do you mean something else?

cp: ‘/gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio/genf90.pl’ and ‘/gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio/genf90.pl’ are the same file

Thanks,

yunqian.zhu@...

Ok. I did copy genf90.pl to the utils directory but it shows the same error when I rebuild model.


Thanks,

jedwards

cheyenne6: /gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio

ls genf90.pl 

genf90.pl

cheyenne6: /gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio

:) ls ../

bin  esmf_wrf_timemgr  mct  pio  pio_old  timing

I don't see it there - am I looking at the correct source

CESM Software Engineer

yunqian.zhu@...

I did the following modification instead and the build is successful now.

In Makefile:

 

GENF90 := /gpfs/u/home/yunqian/cesm/cesm1_1_1_ccmi34/models/utils/pio

In pio_msg_getput_callbacks.F90.in, add:

#define TYPETEXT 100

#define TYPEREAL 101

#define TYPEDOUBLE 102

 

#define TYPEINT 103


I'm able to run the model, however, the model crashes right away with the following error (/gpfs/fs1/scratch/yunqian/Kelut_addhetnuc_16_21km_log0.5um1.5um20um_Gaussian_1.5Tg/run/cesm.log.190320-140834):

1: NetCDF: Numeric conversion not representable

9: NetCDF: Numeric conversion not representable

9: pio_support::pio_die:: myrank=          -1 : ERROR:

37: NetCDF: Numeric conversion not representable

13: NetCDF: Numeric conversion not representable

17: NetCDF: Numeric conversion not representable

21: NetCDF: Numeric conversion not representable

25: NetCDF: Numeric conversion not representable

29: NetCDF: Numeric conversion not representable

41: NetCDF: Numeric conversion not representable

33: NetCDF: Numeric conversion not representable

9: pionfwrite_mod::write_nfdarray_double:         250 :

9: NetCDF: Numeric conversion not representable

17: pio_support::pio_die:: myrank=          -1 : ERROR:

17: pionfwrite_mod::write_nfdarray_double:         250 :

17: NetCDF: Numeric conversion not representable

13: pio_support::pio_die:: myrank=          -1 : ERROR:

13: pionfwrite_mod::write_nfdarray_double:         250 :

 

13: NetCDF: Numeric conversion not representable

237:Image              PC                Routine            Line        Source

237:cesm.exe           0000000001B8352D  Unknown               Unknown  Unknown

237:cesm.exe           0000000001551CD1  pio_support_mp_pi         118  pio_support.F90

237:cesm.exe           000000000154939E  pio_utils_mp_chec          74  pio_utils.F90

237:cesm.exe           00000000016604C3  pionfwrite_mod_mp         250  pionfwrite_mod.F90.in

237:cesm.exe           000000000162CFFC  piodarray_mp_writ         650  piodarray.F90.in

237:cesm.exe           000000000162B09C  piodarray_mp_writ         223  piodarray.F90.in

237:cesm.exe           0000000001630213  piodarray_mp_writ         293  piodarray.F90.in

237:cesm.exe           00000000004B2B02  cam_history_mp_du        4334  cam_history.F90

237:cesm.exe           00000000004944D0  cam_history_mp_ws        4651  cam_history.F90

237:cesm.exe           0000000000488D1C  cam_comp_mp_cam_r         379  cam_comp.F90

237:cesm.exe           0000000000479AE7  atm_comp_mct_mp_a         541  atm_comp_mct.F90

237:cesm.exe           000000000040A756  ccsm_comp_mod_mp_        3485  ccsm_comp_mod.F90

237:cesm.exe           00000000004258C8  MAIN__                     91  ccsm_driver.F90

237:cesm.exe           0000000000407EDE  Unknown               Unknown  Unknown

237:libc-2.19.so       00002AAAAC60EB25  __libc_start_main     Unknown  Unknown

237:cesm.exe           0000000000407DE9  Unknown               Unknown  Unknown

237:MPT ERROR: Rank 237(g:237) is aborting with error code 1.

237:    Process ID: 37890, Host: r5i2n17, Program: /gpfs/fs1/scratch/yunqian/Kelut_addhetnuc_16_21km_log5um_Gaussian_15Tg/bld/cesm.exe

237:    MPT Version: HPE MPT 2.19  12/07/18 05:31:15

 

Thanks,

jedwards
Sorry - please try again with https://github.com/NCAR/ParallelIO.git/tags/pio1_5_10/pio 
You don't need to copy the genf90.pl this time.  

CESM Software Engineer

yunqian.zhu@...

Thank you for the new file. The build is successful.

However, when I run the model, it still shows the same NetCDF problem as I posted above.

It is because the initial file that I use is not compatible with the mpt/2.19? I tried to change the NetCDF and pnetcdf options in env_mech_specific but they don't solve the problem.

Could you suggest some debugging method for me?

 

Thanks,

jedwards

That error indicates that you are trying to write values which are out of the range of the variable type - for example writing NaN in output will generate this error.  

You can add a flag -debug minimal to the FFLAGS in your case Macros file to get a little more debug information or try rebuilding with DEBUG=TRUE 

As the nature of the problem has changed and the issue that opened this ticket has been resolved please open a new ticket if the problem persists.

CESM Software Engineer

mark@...

Hey Jim.

I'm trying to compile spcam2_0-cesm1_1_1.  Per the instructions in this thread I moved pio to pio.old and downloaded pio 1_5_10.  env_mach_specifc looks like this:

module load intel/17.0.1

module load ncarenv/1.2

module load mkl

module load ncarcompilers/0.4.1

module load mpt/2.19

if( $MPILIB == "mpi-serial" ) then

  module load netcdf/4.4.1.1

else

  module load netcdf-mpi/4.4.1.1

  module load pnetcdf/1.11.0

 

endif


But I get the following pio build errors:

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1167): error #6460: This is not a field name that is defined in the encompassing structure.   [REQUEST_CNT]

    File%request_cnt=File%request_cnt+1

---------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1212): error #6385: The highest data type rank permitted is INTEGER(KIND=8).   [REQUEST_CNT]

       allocate(array_of_requests(file%request_cnt), status(file%request_cnt))

---------------------------------------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1212): error #6385: The highest data type rank permitted is INTEGER(KIND=8).   [REQUEST_CNT]

       allocate(array_of_requests(file%request_cnt), status(file%request_cnt))

-----------------------------------------------------------------^

compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)


Any ideas?
Thanks,Mark
jedwards

Hi Mark - I think that you just need to remove and regenerate the fortran files in directory 

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio

Remove any *.F90 files that have cooresponding *.F90.in files and rebuild.    Thanks for using the forum. 

CESM Software Engineer

mark@...

Thanks for replying so quickly, Jim.

So I removed these files:

rm alloc_mod.F90

rm box_rearrange.F90

rm iompi_mod.F90

rm piodarray.F90

rm pio_msg_getput_callbacks.F90

rm pionfatt_mod.F90

rm pionfget_mod.F90

rm pionfput_mod.F90

rm pionfread_mod.F90

rm pionfwrite_mod.F90

rm pio_spmd_utils.F90

rm pio_support.F90

rm rearrange.F90

And did a clean build followed by a build and now I get this:

gmake: *** No rule to make target 'pio_support.F90', needed by 'pio_support.d'.  Stop.


jedwards

Sorry, at the end of the Makefile add a line

pio_support.F90: pio_support.F90.in

 

and try again.

CESM Software Engineer

mark@...

Okay, did that and now I get this error:

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  pio_support.F90

 

ifort: error #10236: File not found:  'pio_support.F90'


Looking in the pio directory it seems like the step where the .F90.in files are used to create the .F90 files is not happening for some reason.  ????
jedwards

Did you correct my spelling or just cut and paste?

CESM Software Engineer

mark@...

I corrected that.  The last three lines of my Makefile look like this:

pio_spmd_utils.F90: pio_spmd_utils.F90.in

pio_msg_getput_callbacks.F90 : pio_msg_getput_callbacks.F90.in

pio_support.F90: pio_support.F90.in


jedwards

Got it now - at the top of the Makefile is a list of the F90.in files pio_support.F90.in needs to be added to that list.  

CESM Software Engineer

mark@...

That fixed it!  pio now compiles as does the full model.  Thanks for your help with this, Jim!

jedwards

Thanks for your patience.  I've updated the pio tag to pio1_5_11 with the required changes. 

CESM Software Engineer

mark@...

I have something odd to report.  I ran the code with this new pio library for almost a simulated year.  This is an older version of SP-CAM, and I have daily history file output turned on as well as the standard monthly mean history files.  For some reason all of the 3D fields that I look at in the monthly mean h0 files are all goofy.  The numbers are non-physical.  But the 2D fields seem quite reasonable.  At first I thought I must have initialized it incorrectly, but then I checked the 3D fields in the h1 history files and they all look reasonable.  

Is there any chance the new pio library is causing this?   

If you want to take a look, the output files are in /glade/scratch/branson/spcam_nlev53/run.  

jedwards

I don't think that the pio library would cause this if the h1 files look okay.   You can also try https://github.com/NCAR/ParallelIO.git/tags/pio1_7_3/pio 

I've confirmed that it works with your model version, but I don't think it'll make any difference.  

CESM Software Engineer

mark@...

I can't get pio1_7_3 to compile successfully.  The Makefile assumes that genf90.pl is located in ../bin but I have no such directory, so I copied genf90.pl over from the other pio version and modified GENF90 in the Makefile, but it's got other problems.  Here's the pio bldlog:

Wed Apr 10 15:38:00 MDT 2019 /glade/scratch/branson/spcam_nlev53/bld/pio/pio.bldlog.190410-153752

Copying source to CCSM EXEROOT...

PIO already built. Checking machine type

Same machine.

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 --> pio.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 > pio.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 --> pio_kinds.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 > pio_kinds.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 --> nf_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 > nf_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 --> ionf_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 > ionf_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 --> pio_types.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 > pio_types.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 --> calcdecomp.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 > calcdecomp.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 --> piolib_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 > piolib_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 --> pio_mpi_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 > pio_mpi_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 --> pio_nf_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 > pio_nf_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 --> pio_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 > pio_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 --> pio_msg_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 > pio_msg_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 --> calcdisplace_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 > calcdisplace_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 --> pio_msg_callbacks.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 > pio_msg_callbacks.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 --> pio_support.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 > pio_support.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 --> C_interface_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 > C_interface_mod.d

Making dependencies for pionfatt_mod.F90 --> pionfatt_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfatt_mod -v SUF=.F90 pionfatt_mod.F90 > pionfatt_mod.d

Making dependencies for pionfread_mod.F90 --> pionfread_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfread_mod -v SUF=.F90 pionfread_mod.F90 > pionfread_mod.d

Making dependencies for pionfwrite_mod.F90 --> pionfwrite_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfwrite_mod -v SUF=.F90 pionfwrite_mod.F90 > pionfwrite_mod.d

Making dependencies for pionfput_mod.F90 --> pionfput_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfput_mod -v SUF=.F90 pionfput_mod.F90 > pionfput_mod.d

Making dependencies for pionfget_mod.F90 --> pionfget_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfget_mod -v SUF=.F90 pionfget_mod.F90 > pionfget_mod.d

/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/alloc_mod.F90.in > alloc_mod.F90

Making dependencies for alloc_mod.F90 --> alloc_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=alloc_mod -v SUF=.F90 alloc_mod.F90 > alloc_mod.d

/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/box_rearrange.F90.in > box_rearrange.F90

Making dependencies for box_rearrange.F90 --> box_rearrange.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=box_rearrange -v SUF=.F90 box_rearrange.F90 > box_rearrange.d

/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/rearrange.F90.in > rearrange.F90

Making dependencies for rearrange.F90 --> rearrange.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=rearrange -v SUF=.F90 rearrange.F90 > rearrange.d

/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/iompi_mod.F90.in > iompi_mod.F90

Making dependencies for iompi_mod.F90 --> iompi_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=iompi_mod -v SUF=.F90 iompi_mod.F90 > iompi_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 --> piodarray.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 > piodarray.d

/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_spmd_utils.F90.in > pio_spmd_utils.F90

Making dependencies for pio_spmd_utils.F90 --> pio_spmd_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_spmd_utils -v SUF=.F90 pio_spmd_utils.F90 > pio_spmd_utils.d

/usr/bin/perl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/genf90.pl /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_getput_callbacks.F90.in > pio_msg_getput_callbacks.F90

Making dependencies for pio_msg_getput_callbacks.F90 --> pio_msg_getput_callbacks.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_msg_getput_callbacks -v SUF=.F90 pio_msg_getput_callbacks.F90 > pio_msg_getput_callbacks.d

Done updating dependencies

gmake[1]: Entering directory '/gpfs/fs1/scratch/branson/spcam_nlev53/bld/pio'

Makefile:157: pio.d: No such file or directory

Makefile:157: pio_kinds.d: No such file or directory

Makefile:157: nf_mod.d: No such file or directory

Makefile:157: ionf_mod.d: No such file or directory

Makefile:157: pio_types.d: No such file or directory

Makefile:157: calcdecomp.d: No such file or directory

Makefile:157: piolib_mod.d: No such file or directory

Makefile:157: pio_mpi_utils.d: No such file or directory

Makefile:157: pio_nf_utils.d: No such file or directory

Makefile:157: pio_utils.d: No such file or directory

Makefile:157: pio_msg_mod.d: No such file or directory

Makefile:157: calcdisplace_mod.d: No such file or directory

Makefile:157: pio_msg_callbacks.d: No such file or directory

Makefile:157: pio_support.d: No such file or directory

Makefile:157: C_interface_mod.d: No such file or directory

Makefile:157: pionfatt_mod.d: No such file or directory

Makefile:157: pionfread_mod.d: No such file or directory

Makefile:157: pionfwrite_mod.d: No such file or directory

Makefile:157: pionfput_mod.d: No such file or directory

Makefile:157: pionfget_mod.d: No such file or directory

Makefile:157: alloc_mod.d: No such file or directory

Makefile:157: box_rearrange.d: No such file or directory

Makefile:157: rearrange.d: No such file or directory

Makefile:157: iompi_mod.d: No such file or directory

Makefile:157: piodarray.d: No such file or directory

Makefile:157: pio_spmd_utils.d: No such file or directory

Makefile:157: pio_msg_getput_callbacks.d: No such file or directory

Making dependencies for pio_msg_getput_callbacks.F90 --> pio_msg_getput_callbacks.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_msg_getput_callbacks -v SUF=.F90 pio_msg_getput_callbacks.F90 > pio_msg_getput_callbacks.d

Making dependencies for pio_spmd_utils.F90 --> pio_spmd_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pio_spmd_utils -v SUF=.F90 pio_spmd_utils.F90 > pio_spmd_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 --> piodarray.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 > piodarray.d

Making dependencies for iompi_mod.F90 --> iompi_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=iompi_mod -v SUF=.F90 iompi_mod.F90 > iompi_mod.d

Making dependencies for rearrange.F90 --> rearrange.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=rearrange -v SUF=.F90 rearrange.F90 > rearrange.d

Making dependencies for box_rearrange.F90 --> box_rearrange.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=box_rearrange -v SUF=.F90 box_rearrange.F90 > box_rearrange.d

Making dependencies for alloc_mod.F90 --> alloc_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=alloc_mod -v SUF=.F90 alloc_mod.F90 > alloc_mod.d

Making dependencies for pionfget_mod.F90 --> pionfget_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfget_mod -v SUF=.F90 pionfget_mod.F90 > pionfget_mod.d

Making dependencies for pionfput_mod.F90 --> pionfput_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfput_mod -v SUF=.F90 pionfput_mod.F90 > pionfput_mod.d

Making dependencies for pionfwrite_mod.F90 --> pionfwrite_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfwrite_mod -v SUF=.F90 pionfwrite_mod.F90 > pionfwrite_mod.d

Making dependencies for pionfread_mod.F90 --> pionfread_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfread_mod -v SUF=.F90 pionfread_mod.F90 > pionfread_mod.d

Making dependencies for pionfatt_mod.F90 --> pionfatt_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=pionfatt_mod -v SUF=.F90 pionfatt_mod.F90 > pionfatt_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 --> C_interface_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/C_interface_mod.F90 > C_interface_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 --> pio_support.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90 > pio_support.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 --> pio_msg_callbacks.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_callbacks.F90 > pio_msg_callbacks.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 --> calcdisplace_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90 > calcdisplace_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 --> pio_msg_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90 > pio_msg_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 --> pio_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90 > pio_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 --> pio_nf_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_nf_utils.F90 > pio_nf_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 --> pio_mpi_utils.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_mpi_utils.F90 > pio_mpi_utils.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 --> piolib_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piolib_mod.F90 > piolib_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 --> calcdecomp.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdecomp.F90 > calcdecomp.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 --> pio_types.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90 > pio_types.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 --> ionf_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/ionf_mod.F90 > ionf_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 --> nf_mod.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90 > nf_mod.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 --> pio_kinds.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90 > pio_kinds.d

Making dependencies for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 --> pio.d

#@awk -f /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/fdepends.awk -v NAME=/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio -v SUF=.F90 /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio.F90 > pio.d

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_kinds.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_support.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_types.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  alloc_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  iompi_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/calcdisplace_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  pio_spmd_utils.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  box_rearrange.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  rearrange.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_utils.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/pio_msg_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/nf_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  pionfwrite_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  pionfread_mod.F90

mpif90 -c -DLINUX -DMCT_INTERFACE -DHAVE_MPI -DFORTRANUNDERSCORE -DNO_R16 -DHAVE_F2008_CONTIGUOUS -DLINUX -DCPRINTEL -DHAVE_SLASHPROC -DSPMD -DHAVE_MPI -DUSEMPIIO -DSYSLINUX -D_NETCDF -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -D_PNETCDF -DTIMING -DPIO_GPFS_HINTS  -O2 -fp-model precise -convert big_endian -assume byterecl -ftz -traceback  -free  -I.  -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I/glade/scratch/branson/spcam_nlev53/bld/mct/mct -I/glade/scratch/branson/spcam_nlev53/bld/mct/mpeu -I/glade/scratch/branson/spcam_nlev53/bld/pio -I/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio -I/glade/scratch/branson/spcam_nlev53/bld/lib/include -I/glade/u/apps/ch/opt/netcdf-mpi/4.4.1.1/mpt/2.19/intel/17.0.1//include   -I/glade/u/apps/ch/opt/pnetcdf/1.11.0/mpt/2.19/intel/17.0.1//include -I../timing  /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(20): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [PIONFWRITE_MOD]

  use pionfwrite_mod, only : write_nf

------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(21): error #7002: Error in opening the compiled module file.  Check INCLUDE paths.   [PIONFREAD_MOD]

  use pionfread_mod, only : read_nf

------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(20): error #6580: Name in only-list does not exist.   [WRITE_NF]

  use pionfwrite_mod, only : write_nf

-----------------------------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90(21): error #6580: Name in only-list does not exist.   [READ_NF]

  use pionfread_mod, only : read_nf

----------------------------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(603): error #6404: This name does not have a type, and must have an explicit type.   [WRITE_NF]

    ierr = write_nf(File,IOBUF,varDesc,iodesc,start,count, request) 

-----------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(603): error #6406: Conflicting attributes or multiple declaration of name.   [WRITE_NF]

    ierr = write_nf(File,IOBUF,varDesc,iodesc,start,count, request) 

-----------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(603): error #6406: Conflicting attributes or multiple declaration of name.   [WRITE_NF]

    ierr = write_nf(File,IOBUF,varDesc,iodesc,start,count, request) 

-----------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(947): error #6404: This name does not have a type, and must have an explicit type.   [READ_NF]

    ierr = read_nf(File,IOBUF,varDesc,iodesc,start(1:ndims),count(1:ndims))

-----------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(947): error #6406: Conflicting attributes or multiple declaration of name.   [READ_NF]

    ierr = read_nf(File,IOBUF,varDesc,iodesc,start(1:ndims),count(1:ndims))

-----------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(947): error #6406: Conflicting attributes or multiple declaration of name.   [READ_NF]

    ierr = read_nf(File,IOBUF,varDesc,iodesc,start(1:ndims),count(1:ndims))

-----------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1199): error #6460: This is not a field name that is defined in the encompassing structure.   [REQUEST_CNT]

    File%request_cnt=File%request_cnt+1

---------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8).   [REQUEST_CNT]

       allocate(array_of_requests(file%request_cnt), status(file%request_cnt))

---------------------------------------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8).   [REQUEST_CNT]

       allocate(array_of_requests(file%request_cnt), status(file%request_cnt))

-----------------------------------------------------------------^

compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)

Makefile:116: recipe for target 'piodarray.o' failed

gmake[1]: *** [piodarray.o] Error 1

gmake[1]: Leaving directory '/gpfs/fs1/scratch/branson/spcam_nlev53/bld/pio'

Makefile:89: recipe for target 'all' failed

gmake: *** [all] Error 2

 

 

jedwards

It looks like you didn't do a clean after the update and before rebuilding - just rm your build directory and start over

CESM Software Engineer

mark@...

Okay, I removed my build directory and started over.  This time I got these errors in the pio bld log file:

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1199): error #6460: This is not a field name that is defined in the encompassing structure.   [REQUEST_CNT]

    File%request_cnt=File%request_cnt+1

---------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8).   [REQUEST_CNT]

       allocate(array_of_requests(file%request_cnt), status(file%request_cnt))

---------------------------------------^

/gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90.in(1237): error #6385: The highest data type rank permitted is INTEGER(KIND=8).   [REQUEST_CNT]

       allocate(array_of_requests(file%request_cnt), status(file%request_cnt))

-----------------------------------------------------------------^

compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)

-----------------------------------------------------------------^

compilation aborted for /gpfs/u/home/branson/spcam2_0-cesm1_1_1/models/utils/pio/piodarray.F90 (code 1)

Makefile:116: recipe for target 'piodarray.o' failed

gmake[1]: *** [piodarray.o] Error 1

gmake[1]: Leaving directory '/gpfs/fs1/scratch/branson/spcam_nlev53/bld/pio'

Makefile:89: recipe for target 'all' failed

gmake: *** [all] Error 2

 
jedwards

try https://github.com/NCAR/ParallelIO.git/tags/pio1_7_4/pio 

but again - I don't think your history file issue is a pio problem.

CESM Software Engineer

mark@...

Well, I tried pio1_7_4 and not only did it compile successfully without any complications, but the 3D fields in the January monthly mean history file all look normal again.  So I'm glad I tried it.  :)

jedwards

Great I was wrong in the right way...

CESM Software Engineer

mark@...

Well, for better or worse you were actually right.  I'm still getting messed up h0 files.  I was initially fooled because after I recompiled the model with pio1_7_4 it ran several months with perfectly fine h0 history files, but then every other one had corrupted 3D fields.  And, just as before, the very same fields (temperature, zonal wind, water vapor mixing ratio) look correct in the daily mean h1 history files.  

I also just tried recompiling a standard CAM case from the same code base, and in a 1-year test only one h0 file was messed up.  I was wondering if somehow the problem would only happen in an SP case, but apparently not.  

I'm at a loss as to how to proceed from here in trying to debug this.  If you have any suggestions, I'm all ears.

Mark

Log in or register to post comments

Who's new

  • hellosyndy@...
  • soorajkrish90@...
  • joao.bettencourt@...
  • oumzh6@...
  • turuncu