First time here? Check out the Help page!

Question-and-Answer Resource for the Building Energy Modeling Community
Get started with the Help page
Ask Your Question
1

Is there a way to sort through the AMY2018 ResStock Parquet Files?

asked 1 year ago

Hi Everyone,

I'm trying to parse through the ResStock OSM building models and so far, the only thing I've seen that pairs up the building energy model file name with what is actually in the model is the .parquet files in each end use profile building stock year. There's 548,916 model files, so I'm not going to download each one to see what's what. I'd be here forever.

I've tried to use the ParquetViewer (https://github.com/mukunku/ParquetVie...) but when I try to search the within the field I want, in this case 'in.geometry_building_type_recs' I get an error. Seems like the IN prefix in the query has some issue, but I can't find out what in the limited wiki resource.

Is everyone using a "BigData" type viewer or something? Ideally I don't have to learn another software just to cull down the Single Family building types and Model ID names to see what the ResStock OSM files look like. But I suppose I can if that's the only way. DuckDB seems like a choice, but perhaps I'm missing something more straightforward. I've searched everywhere for an index or description of what each building energy model is, but I haven't found anything...yet.

Thanks for your help!

Preview: (hide)

Comments

1

In ParquetViewer you can wrap column names in square brackets to handle reserved characters like dots or spaces in column names. So in your case the query would be: "WHERE [in.geometry_building_type_recs] = ..."

woyada9386's avatar woyada9386  ( 1 year ago )

1 Answer

Sort by » oldest newest most voted
3

answered 1 year ago

The easiest way to see the characteristics of each sample is with the metadata .csv files (linked from https://resstock.nrel.gov/datasets). You can use that to filter down to just the IDs that you are interested in and then get those parquet files if you want the timeseries data.

Preview: (hide)
link

Comments

Thanks for pointing that out Eric. I'm a bit embarrassed that I never clicked on the metadata link on the dataset site. I'd always found my way to the data in other ways and ended up with the .parquet files.

bwatanabe's avatar bwatanabe  ( 1 year ago )

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Training Workshops

Careers

Question Tools

1 follower

Stats

Asked: 1 year ago

Seen: 87 times

Last updated: Dec 10 '23