Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Short term archiving stores history files twice - in component/hist and in rest/

P

peter_pfleiderer

Peter
New Member
What version of the code are you using?
release-cesm2.1.5-0-g7a6c5b0

Have you made any changes to files in the source tree?
no changes

Describe every step you took leading up to the problem:
.create_newcase --case 0502-01-01_to_0502-01-30 --res f09_g17 --compset B1850cmip6 --mach levante --compiler intel --mpilib openmpi --queue default --walltime 12:00:00 --handle-preexisting-dirs u --output-root OUTPUT_ROOT/PARENT_SIMULATION/branch/

./xmlchange STOP_OPTION=ndays,STOP_N=29
./xmlchange DOUT_S_ROOT=ARCHIVE_PATH/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30
./xmlchange RUNDIR=OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run
./xmlchange NTASKS_CPL=512,NTASKS_ATM=512,NTASKS_LND=512,NTASKS_ICE=512,NTASKS_OCN=512,NTASKS_ROF=512,NTASKS_GLC=512
./xmlchange ROOTPE_CPL=0,ROOTPE_ATM=0,ROOTPE_OCN=0,ROOTPE_ICE=0,ROOTPE_LND=0,ROOTPE_WAV=0,ROOTPE_GLC=0,ROOTPE_ROF=0,ROOTPE_ESP=0
./xmlchange NTASKS_WAV=16
./xmlchange NTASKS_ESP=1
./xmlchange RUN_TYPE=branch
./xmlchange RUN_REFCASE=PARENT_SIMULATION
./xmlchange RUN_REFDATE=0502-01-01
./xmlchange GET_REFCASE=FALSE

./case.setup
# link all files in rest/ containing "*.r*.*"
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.rh0.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.rh0.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.mosart.rh0.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.mosart.rh0.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.rh1.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.rh1.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.cam.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.cam.r.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.rh2.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.rh2.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.r.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.mosart.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.mosart.r.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.rh3.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.rh3.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.rh4.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.rh4.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.pop.ro.0502-01-01-00000 OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.pop.ro.0502-01-01-00000
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.clm2.rh7.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.clm2.rh7.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.ww3.r.0502-01-01-00000 OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.ww3.r.0502-01-01-00000
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.cpl.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.cpl.r.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.cice.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.cice.r.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.cism.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.cism.r.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.cam.rs.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.cam.rs.0502-01-01-00000.nc
ln -sf ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/PARENT_SIMULATION.pop.r.0502-01-01-00000.nc OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/PARENT_SIMULATION.pop.r.0502-01-01-00000.nc

# copy all rpointer files
cp -va ARCHIVE_PATH/PARENT_SIMULATION/rest/0502-01-01-00000/rpointer.* OUTPUT_ROOT/PARENT_SIMULATION/branch//0502-01-01_to_0502-01-30/run/

./case.build
./case.submit

Describe your problem or question:
After completion of st_archive history files are stored in the rest/ directory.

ls -l atm/hist/
total 75188
-rw-r--r-- 1 USER PROJECT 76988272 Dec 12 16:33 0502-01-01_to_0502-01-30.cam.h1.0502-01-02-00000.nc

ls -l rest/0502-01-30-00000/
total 10089016
-rw-r--r-- 1 USER PROJECT 76988272 Dec 12 16:33 0502-01-01_to_0502-01-30.cam.h1.0502-01-02-00000.nc

Both files seem to be identical (identical size).
As shown in the reproduction description above, I did not use any hist file to run the branch.
To me it's unclear why the hist files are stored once in atm/hist (or other component) and once in rest/
Is there a reason for this? And if not, can I change this behavior?
 
Sort by date Sort by votes
D

dbailey

CSEG and Liaisons
Staff member
I am having trouble understanding what you have done here. Keep in mind that a branch run must be the same configuration that you are starting from. You only need to copy the files from rest/0502-01-30-00000 here. This includes the rpointer files. I would not recommend symbolic links and you do not need anything from atm/hist.

So, you have done a two day run and now want to do a continue run from that? Or do you actually want a branch run?
 
Vote Upvote 0 Downvote
P

peter_pfleiderer

Peter
New Member
Sorry for the confusion.
I just did this little run as an example. The run completed without an error.
Branching works perfectly fine for me.
My question is: Why does the file 0502-01-01_to_0502-01-30.cam.h1.0502-01-02-00000.nc get saved twice? Once in rest/0502-01-30-00000/ and once in atm/hist/
 
Vote Upvote 0 Downvote
You must log in or register to reply here.
Top