-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add example scripts for PBS cluster manager #4
Comments
I have found the solution. "cd /xxx/program/informME-master/MexSource" should be added to the "install.pbs" . But another problem occured.
I will check it tomorrow. Thank you. |
Hello and thank you for your interest in our pipeline. I think you are running into problems because PBS is subtlely different from SGE, and the example submission scripts are designed for SGE. See here for a comparison: https://kb.iu.edu/d/avgl which demonstrates the problem you ran into where our '-wd' flag to set the working directory does not exist in PBS, and so you had to add a change directory command to your script. The version on master, v0.2.2, has only been tested on SGE, so you are blazing a new trail here. The new error you are getting is due to the C++ header file "mpreal.h" not being found in the inclusion path. You can download this file here: http://www.holoborodko.com/pavel/mpfr/ and put it in your eigen folder, and the compiler should find it (and you won't need root permissions to put it in a default inclusion path). Since you have the added difficulty of using PBS, let me propose another option for you: try v0.3.0 that is currently a pull request in this repository https://github.com/GarrettJenkinson/informME/tree/v0.3.0. Jordi and I have been working for months on this total revamp of the software, with one of the main goals being ease of installation. I wrote an interactive installation script that will automatically do many of the things that you are having to do manually in v0.2.2. The version v0.3.0 has been tested on SLURM and SGE clusters, and we are quite happy with it. There might be some minor tweaks coming to the Rscripts postprocessing code before we merge that branch to master and tag it as a release, but you could always just use the v0.2.2 Rscripts for now. Otherwise, I consider the v0.3.0 branch to be ready for use, and it will be much easier to get up and running, especially for someone who has the added complexity of figuring out a different cluster submission system (i.e., PBS). Let me know if you have any further questions or problems. |
Hi, Thank you very much for your help. I will use the v0.3.0, because there are so many jobs I need to submit. You have done a awesome job, and I feel honoured to use your tools. I'm interested in how the environment affects biological processes, and your group have made a great contribution to this direction. Thank you for the great effort you have made to develop and maintain this pipeline. |
Thank you so much for the compliments! I hope v0.3.0 can get you up and running. Please let me know if you run into troubles there and I will try to help as best as I can while not having access to a PBS cluster. We just recently got access to a SLURM cluster to add that functionality to the pipeline. Perhaps if you end up modifying our SGE scripts to make working PBS scripts you could consider making a pull request. We would be happy to have a community contribution that other scientists using PBS might find useful. I'm going to keep this issue open as a place for debugging installation issues on a PBS cluster. I will tag it for now as an enhancement since we would like to support as many cluster architectures as possible. |
I have a very shallow view of this problem. I will be very grateful if you can point out the crucial factor that I've overlooked. I think that maybe you can leave this problem to the users and you don't need to consider which type of server the user have. Because perhaps many users may even not have a computer cluster, just a computer with the Linux system. What you need to consider is to complete the pipeline in the shell environment. The user will choose how they can submit the jobs. If it needs a large amount of calculation, prompt the users and they would know what to do. I believe they can use their computer cluster if they have one. So, don't worry. By the way, I'm not so familiar with the PBS cluster. What I know is how to submit the job and how to get the result. The script for submiting the job is like this:
This script can successfully finish the compiling task as long as all the prerequisites are sastified. Other jobs can also be submitted based on this templet and what users need to do is to replace it with the code in the runXXXX.sh file(for example: runCompileMEX.sh). Note:
from this part
in the runCompileMEX.sh. All I know is this. I don't think I competent to consider all the different situations and parameters needed. It's so complicated. Therefore, I'm so sorry I can't help you. |
Dear sir,
While I was installing the informME, I encountered a problem. Could you give me any advice? Thank you very much.
Firstly, I finished the installing steps of 1, 2 and 4, and then I ran the informME-master/SubmissionScripts/MexSource/runCompileMEX.sh. An error occurred:
So I gave it the queue id of "-q Biocc.ZY" and it liked this:
But it made no sense. Therefore, I submited the job with PBS file named "install.pbs" by the qsub command. As follows:
The error is like this:
Any suggestions would be very helpful. Thank you very much.
The text was updated successfully, but these errors were encountered: