Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time constant of mean reaward is incorrect #28

Open
kappeld opened this issue Oct 19, 2018 · 1 comment
Open

Time constant of mean reaward is incorrect #28

kappeld opened this issue Oct 19, 2018 · 1 comment

Comments

@kappeld
Copy link
Collaborator

kappeld commented Oct 19, 2018

The time constant to compute the mean reward in the pattern matching example seems wrong. The update rate is computed here wrongly with hardcoded 1 ms instead of using the update step of the control node as defined in config.py

https://github.com/IGITUGraz/spore-nest-module/blob/master/examples/pattern_matching_showcase/python/experiment_utils/reward.py#L16

So the effective time constant deviates from the value in seconds (is 750 seconds instead of 50 seconds).

The line should read

self._gamma = np.exp(-music_node_timestep / self._normalization_window)

instead.

@mhoff can you confirm that?

The same problem might also be there in other examples.

@mhoff
Copy link
Collaborator

mhoff commented Oct 19, 2018

@mhoff can you confirm that?

I would agree.

The same problem might also be there in other examples.

Possibly. However, I checked the robotic experiments and they do not appear to be affected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants