Problem in tarring up monthly nc files into annual files when putting on HPSS

[jizhang]

When I was running a CESM1.1 out-of-box run and generated two-year monthly data (24 nc files), I couldn't tar up the monthly files into annual tar file and put them on HPSS. The files can be successfully written on HPSS, but they are still 24 nc files, even though I have set DOUT_L_HTAR = TRUE in env_run.xml. Actually it occurs no matter what compset I have and how long I run the model. Does anyone have idea?The CESM version is cesm1_1_1_alpha01c.-------------------------------------------------------------------------------------------------------env_run.xml reads (related to long term archiver)



-------------------------------------------------------------------------------------------------------$CASE.l_archive reads#! /bin/csh -f
#BSUB -n 1
#BSUB -o poe.harout.%J
#BSUB -e poe.harerr.%J
#BSUB -W 3:00
#BSUB -q hpss
#BSUB -P P35381139
#BSUB -J restore.t04.l_archive#-----------------------------------------------------------------------
# Determine necessary environment variables
#-----------------------------------------------------------------------cd /glade/u/home/jizhang/scripts/restore.t04source ./Tools/ccsm_getenv || exit -1#----------------------------------------------
# run the long term archiver
#----------------------------------------------cd $DOUT_S_ROOT
$CASEROOT/Tools/lt_archive.sh -m copy_dirs_hsi
exit 0

 

[mai]

This option proved to be problematic and has not been available for at least two years. Something like this may be implemented in a future version. The backend output/workflow issues are being looked at carefully right now by the developers.

 

[jizhang]

MaiThank you for answering this question. In this way, I'm thinking to modify the $CASEROOT/Tools/lt_archive.sh. When "$mode" == "copy_dirs_hsi" Either use HTAR, or follow the old CCSM3 code to first tar up and then upload. I'll take a try and keep this post updated if I succeed.