wlee@purdue_edu
New Member
Dear guru,
I am porting CCSM3.0 at intel linux machine.
I am using pgf90 fortran compiler. I set Macro.Linux and all other scripts (batch.linux.steele, env.linux.steele, run.linux.steele). I created a case like
[wlee@tg-steele scripts]$ ./create_newcase -case /grp/tgportal/CCSM/ccsm3_0/test_dir/my_case62 -mach steele
After configuring, I tried below, but had errors
[wlee@tg-steele my_case62]$ ./my_case62.steele.build
-------------------------------------------------------------------------
## Warning: SCRATCH not defined in system environment. Set SCRATCH to be /home/ba01/u106/wlee
-------------------------------------------------------------------------
Preparing T42_gx1v3 component models for execution
-------------------------------------------------------------------------
- Create execution directories for atm,cpl,lnd,ice,ocn
- If a restart run then copy restart files into executable directory
ccsm_getrestart: get /grp/tgportal/CCSM/ccsm-work/my_case62 restarts from /grp/tgportal/CCSM/ccsm-data/archive/wlee/my_case62/restart
- Check validity of configuration
- Determine if build must happen (env variable BLDTYPE)
- Build flag (BLDTYPE) is TRUE
- Build Libraries: esmf, mph, mct
Wed Jul 9 23:22:59 EDT 2008 esmf.buildlib.080709-232259
Wed Jul 9 23:23:00 EDT 2008 mph.buildlib.080709-232259
Wed Jul 9 23:23:00 EDT 2008 mct.buildlib.080709-232259
- Create model directories for each platform
- Determine if models must be rebuilt
- Build model executables, create namelist files, prestage input data
Wed Jul 9 23:23:00 EDT 2008 /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.log.080709-232259
Wed Jul 9 23:23:00 EDT 2008 /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.buildexe.080709-232259
ERROR: cpl.buildexe.csh failed, see cpl.buildexe.080709-232259
ERROR: cat /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.buildexe.080709-232259
-----------------------------------------------------------------------
[wlee@tg-steele my_case62]$ cat /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.buildexe.080709-232259
--------------------------------------------------------------------------
*
*
PGF90-F-0004-Unable to open MODULE file m_mctworld.mod (/usr/rmt_share/p6/CCSM/ccsm3_0/models/csm_share/cpl/cpl_mct_mod.F90: 37)
PGF90/x86-64 Linux 7.1-6: compilation aborted
gmake: *** [cpl_mct_mod.o] Error 2
--------------------------------------------------------------------------
[wlee@tg-steele mct]$ vi mct.buildlib.080709-232259
--------------------------------------------------------------------------
*
*
make[1]: Entering directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case60/mct/mpeu'
pgf90 -c -DSYSLINUX -DCPRPGI -O2 -pc 64 m_mpif.F90
PGF90-S-0017-Unable to open include file: mpif.h (m_mpif.F90: 60)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_integer (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_real (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_double_precision (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_logical (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_character (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_real4 (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_real8 (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_comm_world (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_comm_null (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_sum (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_prod (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_min (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_max (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_max_error_string (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_status_size (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_any_source (m_mpif.F90: 68)
0 inform, 16 warnings, 1 severes, 0 fatal for m_mpif
make[1]: *** [m_mpif.o] Error 2
make[1]: Leaving directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case62/mct/mpeu'
make[1]: Entering directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case62/mct/mct'
make[1]: *** No rule to make target `/grp/tgportal/CCSM/ccsm-work/my_case62/mct/mpeu/libmpeu.a', needed by `m_MCTWorld.o'. Stop.
make[1]: Leaving directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case62/mct/mct'
cp: No match.
cp: No match.
cp: No match.
--------------------------------------------------------------------------
My Macro.Linux file looks like this
--------------------------------------------------------------------------
INCLDIR = -I./ -I/apps/steele/mpich2-1.0.7/64/nemesis-pgi-7.1-6/include -I/apps/steele/mpich2-1.0.7/64/ssm-pgi-7.1-6/include -I/apps/steele/mpich2-1.0.7/64/ssm-intel-10.1.015/include -I/apps/steele/mpich-1.2.7p1/32/p4-pgi-7.1-6/include -I/apps/steele/mpich-1.2.7p1/32/p4-intel-10.1.015/include -I/apps/steele/mvapich2-1.0.2p1/64/ib-pgi-7.1-6/include
SLIBS = -L/lib -L/usr/lib -lnetcdf -L/grp/tgportal/CCSM/netcdf/lib -lmpich -L/apps/steele/mpich-1.2.7p1/64/p4-gcc-4.3.0/lib -L/apps/steele/pgi-7.1-6/linux86/7.1-6/lib -L/apps/steele/mpich-1.2.7p1/64/p4-pgi-7.1-6/lib -L/apps/steele/mpich-1.2.7p1/64/p4-pgi-6.0-5/lib -L/apps/steele/mpich-1.2.7p1/64/p4-pgi-6.1-2/lib -L/apps/steele/mpich-1.2.7p1/64/shmem-intel-10.1.015/lib -L/apps/steele/mpich-1.2.7p1/64/shmem-intel-10.1.015/lib/shared -llapack -L/apps/steele/Python-2.5.2-intel32/lib/python2.5/site-packages/scipy/lib/lapack -L/apps/steele/pgi-7.1-6/linux86-64/7.1-6/lib -lblas
ULIBS = -L$(LIBROOT) -lesmf -lmct -lmpeu -lmph
CPP = NONE
CXX = pgcpp
CPPFLAGS = -DLINUX -DPGF90 -DNO_SHR_VMATH
CPPDEFS = -DLINUX
CC = pgcc
CFLAGS = -c
ifeq ($(CC),pgcc)
CFLAGS += -fast
else
CFLAGS += -DUSE_GCC
endif
FIXEDFLAGS =
FC = pgf90
F90 = pgf90
FFLAGS = -c -DLINUX -DPGF90
MOD_SUFFIX = mod
LD = $(FC)
ifeq ($(CC),gcc)
LDFLAGS += -g77libs="-L/usr/local/pgi/linux86/lib -lpgf90 -lpgf90rtl -lpgftnrtl -lpgc"
endif
AR = ar
--------------------------------------------------------------
Main problem is that mpif.h is not found though the include path is included in the macro file.
Any comment to check would be very appreciated.
Thank you!
I am porting CCSM3.0 at intel linux machine.
I am using pgf90 fortran compiler. I set Macro.Linux and all other scripts (batch.linux.steele, env.linux.steele, run.linux.steele). I created a case like
[wlee@tg-steele scripts]$ ./create_newcase -case /grp/tgportal/CCSM/ccsm3_0/test_dir/my_case62 -mach steele
After configuring, I tried below, but had errors
[wlee@tg-steele my_case62]$ ./my_case62.steele.build
-------------------------------------------------------------------------
## Warning: SCRATCH not defined in system environment. Set SCRATCH to be /home/ba01/u106/wlee
-------------------------------------------------------------------------
Preparing T42_gx1v3 component models for execution
-------------------------------------------------------------------------
- Create execution directories for atm,cpl,lnd,ice,ocn
- If a restart run then copy restart files into executable directory
ccsm_getrestart: get /grp/tgportal/CCSM/ccsm-work/my_case62 restarts from /grp/tgportal/CCSM/ccsm-data/archive/wlee/my_case62/restart
- Check validity of configuration
- Determine if build must happen (env variable BLDTYPE)
- Build flag (BLDTYPE) is TRUE
- Build Libraries: esmf, mph, mct
Wed Jul 9 23:22:59 EDT 2008 esmf.buildlib.080709-232259
Wed Jul 9 23:23:00 EDT 2008 mph.buildlib.080709-232259
Wed Jul 9 23:23:00 EDT 2008 mct.buildlib.080709-232259
- Create model directories for each platform
- Determine if models must be rebuilt
- Build model executables, create namelist files, prestage input data
Wed Jul 9 23:23:00 EDT 2008 /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.log.080709-232259
Wed Jul 9 23:23:00 EDT 2008 /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.buildexe.080709-232259
ERROR: cpl.buildexe.csh failed, see cpl.buildexe.080709-232259
ERROR: cat /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.buildexe.080709-232259
-----------------------------------------------------------------------
[wlee@tg-steele my_case62]$ cat /grp/tgportal/CCSM/ccsm-work/my_case62/cpl/cpl.buildexe.080709-232259
--------------------------------------------------------------------------
*
*
PGF90-F-0004-Unable to open MODULE file m_mctworld.mod (/usr/rmt_share/p6/CCSM/ccsm3_0/models/csm_share/cpl/cpl_mct_mod.F90: 37)
PGF90/x86-64 Linux 7.1-6: compilation aborted
gmake: *** [cpl_mct_mod.o] Error 2
--------------------------------------------------------------------------
[wlee@tg-steele mct]$ vi mct.buildlib.080709-232259
--------------------------------------------------------------------------
*
*
make[1]: Entering directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case60/mct/mpeu'
pgf90 -c -DSYSLINUX -DCPRPGI -O2 -pc 64 m_mpif.F90
PGF90-S-0017-Unable to open include file: mpif.h (m_mpif.F90: 60)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_integer (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_real (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_double_precision (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_logical (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_character (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_real4 (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_real8 (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_comm_world (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_comm_null (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_sum (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_prod (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_min (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_max (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_max_error_string (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_status_size (m_mpif.F90: 68)
PGF90-W-0155-MODULE PROCEDURE not defined: mpi_any_source (m_mpif.F90: 68)
0 inform, 16 warnings, 1 severes, 0 fatal for m_mpif
make[1]: *** [m_mpif.o] Error 2
make[1]: Leaving directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case62/mct/mpeu'
make[1]: Entering directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case62/mct/mct'
make[1]: *** No rule to make target `/grp/tgportal/CCSM/ccsm-work/my_case62/mct/mpeu/libmpeu.a', needed by `m_MCTWorld.o'. Stop.
make[1]: Leaving directory `/usr/rmt_share/p6/CCSM/ccsm-work/my_case62/mct/mct'
cp: No match.
cp: No match.
cp: No match.
--------------------------------------------------------------------------
My Macro.Linux file looks like this
--------------------------------------------------------------------------
INCLDIR = -I./ -I/apps/steele/mpich2-1.0.7/64/nemesis-pgi-7.1-6/include -I/apps/steele/mpich2-1.0.7/64/ssm-pgi-7.1-6/include -I/apps/steele/mpich2-1.0.7/64/ssm-intel-10.1.015/include -I/apps/steele/mpich-1.2.7p1/32/p4-pgi-7.1-6/include -I/apps/steele/mpich-1.2.7p1/32/p4-intel-10.1.015/include -I/apps/steele/mvapich2-1.0.2p1/64/ib-pgi-7.1-6/include
SLIBS = -L/lib -L/usr/lib -lnetcdf -L/grp/tgportal/CCSM/netcdf/lib -lmpich -L/apps/steele/mpich-1.2.7p1/64/p4-gcc-4.3.0/lib -L/apps/steele/pgi-7.1-6/linux86/7.1-6/lib -L/apps/steele/mpich-1.2.7p1/64/p4-pgi-7.1-6/lib -L/apps/steele/mpich-1.2.7p1/64/p4-pgi-6.0-5/lib -L/apps/steele/mpich-1.2.7p1/64/p4-pgi-6.1-2/lib -L/apps/steele/mpich-1.2.7p1/64/shmem-intel-10.1.015/lib -L/apps/steele/mpich-1.2.7p1/64/shmem-intel-10.1.015/lib/shared -llapack -L/apps/steele/Python-2.5.2-intel32/lib/python2.5/site-packages/scipy/lib/lapack -L/apps/steele/pgi-7.1-6/linux86-64/7.1-6/lib -lblas
ULIBS = -L$(LIBROOT) -lesmf -lmct -lmpeu -lmph
CPP = NONE
CXX = pgcpp
CPPFLAGS = -DLINUX -DPGF90 -DNO_SHR_VMATH
CPPDEFS = -DLINUX
CC = pgcc
CFLAGS = -c
ifeq ($(CC),pgcc)
CFLAGS += -fast
else
CFLAGS += -DUSE_GCC
endif
FIXEDFLAGS =
FC = pgf90
F90 = pgf90
FFLAGS = -c -DLINUX -DPGF90
MOD_SUFFIX = mod
LD = $(FC)
ifeq ($(CC),gcc)
LDFLAGS += -g77libs="-L/usr/local/pgi/linux86/lib -lpgf90 -lpgf90rtl -lpgftnrtl -lpgc"
endif
AR = ar
--------------------------------------------------------------
Main problem is that mpif.h is not found though the include path is included in the macro file.
Any comment to check would be very appreciated.
Thank you!