huangfu/InteractionImitation
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add tuning script for GAIL (TRPO)

Browse Source
This commit is contained in:
ebuehrle
2022-02-27 14:28:25 +01:00
parent 4b4fa7e09a
commit 4443492d3e
2 changed files with 238 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/core/gail.py
View File

@@ -38,7 +38,7 @@ def gail(env_fn, expert_data, discriminator, disc_opt, disc_iters, policy, value
logger.add_scalar('expert/mean_episode_length', (~expert_data.dones).sum() / expert_data.states.shape[0])
logger.add_scalar('expert/mean_reward_per_episode', expert_data.rewards[~expert_data.dones].sum() / expert_data.states.shape[0])
for epoch in tqdm(range(epochs)):
for epoch in range(epochs):
states, actions, rewards, dones, collisions = rollout(env_fn, policy, rollout_episodes, rollout_steps)
generator_data = Buffer(states, actions, rewards, dones)