Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consultation about More Details of SCHRL #1

Open
Charlie0257 opened this issue Oct 11, 2022 · 2 comments
Open

Consultation about More Details of SCHRL #1

Charlie0257 opened this issue Oct 11, 2022 · 2 comments

Comments

@Charlie0257
Copy link

After reading your ICLR_2023 paper, Constrained Hierarchical Deep Reinforcement Learning with Differentiable Formal Specifications, I am very interested in it!

However, this project only shows part of the code so far:(
I am very interested in Neural ODE which plays a role in high-level planning. (There are a lot of details that I couldn't understand when reading the article :(

Could you publish the full code?

Thanks for any help :)

@a-n-onymous
Copy link
Owner

Thanks for your interests in our paper!

I am on traveling these days, and we hope to publish a high-quality code repository that is easy to use, so this can take a bit longer. The pretrained models and hierarchical learning code should be public these two days.

As for neural ODE, the architecture is already public here. In the paper, Appendix F and Fig. 10(b) provide some more details about the neural ODE. We used the simplest Euler ODE with fixed time step. The key idea of neural ODE is to predict the derivative of states, instead of directly predicting the states (which is similar to ResNet).

@Charlie0257
Copy link
Author

Thank you for your answer :)

I see that you have published the code for the task.
Could you update the corresponding command line in the README so that I can reproduce the results in the paper?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants