Scheduled Downtime
On Tuesday 24 October 2023 @ 5pm MT the forums will be in read only mode in preparation for the downtime. On Wednesday 25 October 2023 @ 5am MT, this website will be down for maintenance and expected to return online later in the morning.
Normal Operations
The forums are back online with normal operations. If you notice any issues or errors related to the forums, please reach out to help@ucar.edu

Monthly Q2M - missing member data

columbiawildfire

Caroline
New Member
I've been using data from the CESM2 LENS outputs: I'm using monthly Q2M (2m specific humidity) from the "land" component to calculate near-surface vapor-pressure deficit (VPD). I've discovered an issue where certain members are either missing data completely or are missing some years of their data (either historical only, or the future projections only), but I wasn't able to find any information about it. Why are members missing, and is there a dataset that you can recommend for calculating VPD? Thank you in advance!

As for the members that are missing data, here are the ones I've found:
members that did not have data
['f09_g17LE2-1011001' 'f09_g17LE2-1031002' 'f09_g17LE2-1051003'
'f09_g17LE2-1071004' 'f09_g17LE2-1091005' 'f09_g17LE2-1111006'
'f09_g17LE2-1131007' 'f09_g17LE2-1151008' 'f09_g17LE2-1171009'
'f09_g17LE2-1191010']
members missing half their data
['f09_g17LE2-1251011' 'f09_g17LE2-1251012' 'f09_g17LE2-1251013'
'f09_g17LE2-1251014' 'f09_g17LE2-1251015' 'f09_g17LE2-1251016'
'f09_g17LE2-1251017' 'f09_g17LE2-1251018' 'f09_g17LE2-1251019'
'f09_g17LE2-1251020' 'f09_g17LE2-1281011']


What version of the code are you using?
Using CESM2 LENS outputs, the same one available here: Dataset: ucar.cgd.cesm2le.lnd.proc.monthly_ave.Q2M
or with the pathway: '/glade/campaign/cgd/cesm/CESM2-LE/timeseries/lnd//proc/tseries/month_1/Q2M/'

Have you made any changes to files in the source tree?
None

Describe every step you took leading up to the problem:
(1) Use the python download script from the website download to get all the filenames of all the members (e.g. b.e21.BSSP370smbb.f09_g17.LE2-1281.011.clm2.h2...)
(2) open all the datasets in JupyterHub in a python notebook, using xarray and the code: xr.open_mfdataset(tmpfilenames, combine="by_coords")
(3) Run into an error if the filenames are missing completely, or if the combined DataArray has a shorter "time" dimension than expected.

If this is a port to a new machine: Please attach any files you added or changed for the machine port (e.g., config_compilers.xml, config_machines.xml, and config_batch.xml) and tell us the compiler version you are using on this machine.
Please attach any log files showing error messages or other useful information.

n/a
 

islas

Moderator
Staff member
I'm not sure why there's missing data here from the land component. But I think you can use QREFHT from the atmosphere component and I think all members are available there.

Isla
 

strandwg

Moderator
Staff member
I'm not sure why there's missing data here from the land component. But I think you can use QREFHT from the atmosphere component and I think all members are available there.

Isla
Data aren't missing just not readily available on CDG. That will be fixed.
 
Top