Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does rollout.py work with qmix? #70

Open
nsa26 opened this issue Mar 22, 2021 · 0 comments
Open

Does rollout.py work with qmix? #70

nsa26 opened this issue Mar 22, 2021 · 0 comments

Comments

@nsa26
Copy link

nsa26 commented Mar 22, 2021

I am trying to evaluate qmix trained model using rollout.py but I am getting the following:

checkpoint: /home/ray_results/QMIX2/checkpoint_2/checkpoint-2
2021-03-22 17:27:39,867 INFO trainable.py:489 -- Current state after restoring: {'_iteration': 2, '_timesteps_total': None, '_time_total': 4.807272911071777, '_episodes_total': 200}
Traceback (most recent call last):
File "rollout.py", line 562, in
run(args, parser)
File "rollout.py", line 376, in run
True, None)
File "rollout.py", line 509, in rollout
policy_id=policy_id)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/agents/trainer.py", line 831, in compute_action
explore=explore)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/policy/policy.py", line 207, in compute_single_action
timestep=timestep)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/agents/qmix/qmix_policy.py", line 287, in compute_actions
explore=explore)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/exploration/epsilon_greedy.py", line 80, in get_exploration_action
timestep)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/exploration/epsilon_greedy.py", line 146, in _get_torch_exploration_action
epsilon = self.epsilon_schedule(self.last_timestep)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/schedule.py", line 45, in call
return self.value(t)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/schedule.py", line 40, in value
return self._value(t)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/piecewise_schedule.py", line 53, in _value
if l_t <= t < r_t:
TypeError: '<=' not supported between instances of 'int' and 'NoneType'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant