Arec Jamgochian
|
59083ebce3
|
making option list indexable to visualize in tensorboard. noticing run from last night had much better performance under more long options, unclear if due to choice or environment factors, like episodes lasting longer. making stoponcollision and seed parameters. fixing ability to see reward metrics under ray/tune/, problem was they were being returned as tensors, not floats
|
2022-02-25 16:36:14 -08:00 |
|
Arec Jamgochian
|
d1f23e6d25
|
readding expertdata to gitignore, just manually adding expert joint state and action files
|
2022-02-25 01:27:02 -08:00 |
|
Arec Jamgochian
|
46564231ef
|
changing gitignore to upload expert data for evaluation, adding multiple roundabout trackfile environments in vecenv
|
2022-02-25 01:21:16 -08:00 |
|
Arec Jamgochian
|
bf9ce84fe4
|
changing when directory name gets saved
|
2022-02-25 00:42:44 -08:00 |
|
Arec Jamgochian
|
99aa50a08b
|
added support for different activations, number of hidden layers, options, running a big run over this
|
2022-02-25 00:00:04 -08:00 |
|
Arec Jamgochian
|
7feea74eb8
|
adding stablebaselines, adding safe loading for nonCuda cluster
|
2022-02-24 23:18:02 -08:00 |
|
ebuehrle
|
5a5d8a7aff
|
WIP: Support different plan lengths
|
2022-02-25 01:32:54 +01:00 |
|
ebuehrle
|
02c1813b00
|
Incrementing agent expert data, smaller policy network
|
2022-02-25 01:23:15 +01:00 |
|
Johannes Fischer
|
0d193d4af3
|
Scratch for horner scheme
|
2022-02-24 15:12:29 +01:00 |
|
ebuehrle
|
febceed651
|
Add expert data
|
2022-02-23 18:17:30 +01:00 |
|
ebuehrle
|
336cf02278
|
Parameterize hidden layer size of policy, add some candidates to grid search
|
2022-02-23 18:14:23 +01:00 |
|
ebuehrle
|
7f64ec7bb0
|
Move hyperparameters to config object
ToDo: parameterize network architectures
|
2022-02-23 18:00:19 +01:00 |
|
ebuehrle
|
406c4ad9ee
|
Fix tune by moving file
|
2022-02-23 17:41:41 +01:00 |
|
ebuehrle
|
f037c119cc
|
Set up for ray tune
|
2022-02-23 16:55:13 +01:00 |
|
ebuehrle
|
91f88983b0
|
Add learning rate schedule to SHAIL-PPO
|
2022-02-23 14:22:02 +01:00 |
|
Arec
|
68b066ec53
|
adding success rate, total distance, and survive time
|
2022-02-22 00:48:35 -08:00 |
|
Arec
|
e7f4f6a871
|
wrapping all environments in timelimit to stop runs longer than 100s, since some others were erroring
|
2022-02-21 17:54:29 -08:00 |
|
Arec
|
e7f8385628
|
updating rwse to work at different times, updating correct testing environment from roundabout, removing the assertion that a collision implies done in the evaluator, using nanmean and nanstd in averaging
|
2022-02-21 15:55:16 -08:00 |
|
ebuehrle
|
daa4825f17
|
Add GAIL-PPO
|
2022-02-21 22:21:13 +01:00 |
|
ebuehrle
|
a89317e1d5
|
Correct checkpoint file path
|
2022-02-21 22:11:34 +01:00 |
|
ebuehrle
|
b89f5db9d8
|
Add SHAIL policy with more options
|
2022-02-21 22:07:44 +01:00 |
|
ebuehrle
|
953a93a541
|
Add two checkpoints for SHAIL-PPO
|
2022-02-21 17:33:08 +01:00 |
|
ebuehrle
|
a242edc5d3
|
Fix predict for reparameterized modules
Better way would probably be to rewrite flat_grad and reparam
|
2022-02-21 13:29:53 +01:00 |
|
ebuehrle
|
2da0e05782
|
Implement rwse
|
2022-02-21 11:05:19 +01:00 |
|
Arec
|
8c4ff03208
|
adding average absolute delta v, and tracking positions and setting up architecture to implement rwse
|
2022-02-21 00:06:39 -08:00 |
|
Arec
|
d2932951f6
|
adding metric saving and averaging over seeds
|
2022-02-20 23:22:46 -08:00 |
|
Arec Jamgochian
|
a7102a29df
|
Merge pull request #4 from sisl/options
Integrate options env and policy
|
2022-02-20 20:20:28 -08:00 |
|
ebuehrle
|
ce22516893
|
Fix imports
|
2022-02-18 10:18:10 +01:00 |
|
ebuehrle
|
84351e77f2
|
Add SHAIL-PPO
|
2022-02-18 06:54:52 +01:00 |
|
ebuehrle
|
1624e1a349
|
Add SHAIL
|
2022-02-17 23:51:40 +01:00 |
|
ebuehrle
|
9de6bfe9a3
|
Add GAIL
|
2022-02-17 22:58:00 +01:00 |
|
ebuehrle
|
cd58ce2898
|
Remove old code
|
2022-02-17 22:43:41 +01:00 |
|
ebuehrle
|
5bd8b42d9f
|
Merge updated files
|
2022-02-17 22:41:55 +01:00 |
|
ebuehrle
|
b78f95bab5
|
More checkpoints, adjustments for collision check
|
2022-02-16 10:19:50 +01:00 |
|
ebuehrle
|
c5e68ca33a
|
Add model checkpoint
|
2022-02-15 22:01:28 +01:00 |
|
ebuehrle
|
c6a4c10605
|
Integrate options env and policy
|
2022-02-15 18:36:53 +01:00 |
|
ebuehrle
|
072c0ff417
|
Copy files
|
2022-02-15 14:03:22 +01:00 |
|
ebuehrle
|
a3b9b3e250
|
Port TRPO, PPO, GAIL
|
2022-02-15 11:07:08 +01:00 |
|
Arec
|
530ac95d61
|
Merge branch 'test' into main
|
2022-02-05 21:50:16 -08:00 |
|
Arec
|
3e6fce42ee
|
BUG FIXES: moving around when policy is loaded, adding BaseAlgorithm abstract classes, correcting metrics, normalizng actions if idm environment is a normalized action one, manually updating environment graph when using idm, implementing idm forward class
|
2022-02-05 21:48:56 -08:00 |
|
Arec
|
795e1c08b6
|
adding metric comparisons and updating (note: pre-debug) init
|
2022-02-04 15:51:17 -08:00 |
|
Arec
|
d1f9e3d7c4
|
adding main test sequence. must debug and add summary and comparison metric generators tomorrow
|
2022-02-02 22:29:05 -08:00 |
|
Arec
|
31912416f1
|
adding pbar to evaluator and making metric save optional, adding typing to baselines
|
2022-02-02 22:19:40 -08:00 |
|
Arec
|
3ce86b31f7
|
adding Prop controller and IDMRulePolicy
|
2022-02-02 15:43:23 -08:00 |
|
Arec
|
3991306da0
|
updating evaluation wrapper to only store relevant variables during execution
|
2022-01-31 16:28:13 -08:00 |
|
ebuehrle
|
a60cc18874
|
PPO lidar + random agent
|
2022-01-22 08:05:16 +01:00 |
|
ebuehrle
|
18af0de2a4
|
Add experiment for PPO on lidar observations
|
2022-01-22 07:49:48 +01:00 |
|
ebuehrle
|
52d4b5a36c
|
Refactor LL buffer
|
2022-01-21 10:22:33 +01:00 |
|
Arec
|
3b60c14319
|
removing old implementation for rollout_and_save, and helper functions that were necessary for it
|
2022-01-18 18:03:38 -08:00 |
|
Arec
|
427a9e4f1b
|
adding rollout and trajectory flattening utilities. including old implementation in this commit
|
2022-01-18 17:53:56 -08:00 |
|