Question-and-Answer Resource for the Building Energy Modeling Community
Get started with the Help page
Ask Your Question
1

Parallel processing of jobs with OpenStudio 2.1 Linux

asked 2017-06-02 09:27:10 -0600

updated 2017-08-06 07:30:17 -0600

To run multiple models, I modify the contents in compact.osw by using Python, and then change the models by using the compact.osw. After that, I can run the new models. (''' cd path/to/Examples/compact_osw ./path/to/openstudio.exe run -w compact.osw ''') Now, I want to make the works parallel. Because I use OpenStudio 2.1 in Ubuntu and decide to do sampling methods locally, I do not want to use PAT to do the work. Does anyone have some experience about such work. Are any packages in Python, such as joblib.Parallel, pp, recommended to do the work?

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
2

answered 2017-06-02 10:50:05 -0600

updated 2017-06-02 10:52:20 -0600

You could use python's threading module to make multiple calls to the CLI in parallel. The subprocess module can be used for the actual call. (For ruby, the parallel gem coupled with a system call would work nicely.)

You'll also need to specify a different run_directory (and maybe others?) in the OSW so that the runs don't try to use the same directory -- or simply put the OSWs in different directories.

edit flag offensive delete link more

Comments

Thanks. I will try to do the work by using the method that you mention.

Yunyang Ye gravatar imageYunyang Ye ( 2017-06-02 11:47:36 -0600 )edit

@Yunyang Ye Did this work?

Determinant gravatar imageDeterminant ( 2017-09-13 18:51:31 -0600 )edit

@Determinant I am working on that in a new supercomputer now. It seems work, and if I have a new progress, I will tell you.

Yunyang Ye gravatar imageYunyang Ye ( 2017-09-28 15:37:06 -0600 )edit

@Yunyang Ye that's really great. Thanks for doing this. If they stop supporting the PAT on Linux this will be our only way to go. Please do keep me informed.

Determinant gravatar imageDeterminant ( 2017-10-04 17:36:54 -0600 )edit

I have running code using Python's subprocess.call. It's great but the problem is that the directories in the OSW have to be absolute. The default directory used by the openstudio command doesn't work for some reason. Absolute paths make the results subdirectories messy. Any ideas?

Determinant gravatar imageDeterminant ( 2018-08-27 15:12:38 -0600 )edit
2

answered 2017-06-02 09:32:30 -0600

You need to provision your machine with OpenStudio Server and invoke the OpenStudio Meta CLI directly for your application. OpenStudio Server has an embedded instance of R to manage parallelization of algorithms. Learn more here.

edit flag offensive delete link more

Comments

Does it use the snow (Simple Network of Workstations) package in R to manage parallelization of algorithms?

Yunyang Ye gravatar imageYunyang Ye ( 2017-06-02 09:53:51 -0600 )edit

Snowfall, which I believe is derivative of SNOW.

ljbrackney gravatar imageljbrackney ( 2017-06-02 10:49:20 -0600 )edit

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

 

Question Tools

1 follower

Stats

Asked: 2017-06-02 09:27:10 -0600

Seen: 82 times

Last updated: Jun 02 '17