Question-and-Answer Resource for the Building Energy Modeling Community
Get started with the Help page
Ask Your Question
1

Is there a way to sort through the AMY2018 ResStock Parquet Files?

asked 2023-12-08 14:16:06 -0600

Hi Everyone,

I'm trying to parse through the ResStock OSM building models and so far, the only thing I've seen that pairs up the building energy model file name with what is actually in the model is the .parquet files in each end use profile building stock year. There's 548,916 model files, so I'm not going to download each one to see what's what. I'd be here forever.

I've tried to use the ParquetViewer (https://github.com/mukunku/ParquetVie...) but when I try to search the within the field I want, in this case 'in.geometry_building_type_recs' I get an error. Seems like the IN prefix in the query has some issue, but I can't find out what in the limited wiki resource.

Is everyone using a "BigData" type viewer or something? Ideally I don't have to learn another software just to cull down the Single Family building types and Model ID names to see what the ResStock OSM files look like. But I suppose I can if that's the only way. DuckDB seems like a choice, but perhaps I'm missing something more straightforward. I've searched everywhere for an index or description of what each building energy model is, but I haven't found anything...yet.

Thanks for your help!

edit retag flag offensive close merge delete

Comments

1

In ParquetViewer you can wrap column names in square brackets to handle reserved characters like dots or spaces in column names. So in your case the query would be: "WHERE [in.geometry_building_type_recs] = ..."

woyada9386's avatar woyada9386  ( 2024-02-10 05:52:19 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted
3

answered 2023-12-10 14:27:29 -0600

The easiest way to see the characteristics of each sample is with the metadata .csv files (linked from https://resstock.nrel.gov/datasets). You can use that to filter down to just the IDs that you are interested in and then get those parquet files if you want the timeseries data.

edit flag offensive delete link more

Comments

Thanks for pointing that out Eric. I'm a bit embarrassed that I never clicked on the metadata link on the dataset site. I'd always found my way to the data in other ways and ended up with the .parquet files.

bwatanabe's avatar bwatanabe  ( 2023-12-10 18:11:24 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Training Workshops

Careers

Question Tools

1 follower

Stats

Asked: 2023-12-08 14:16:06 -0600

Seen: 72 times

Last updated: Dec 10 '23