Commit Graph

322 Commits

Author SHA1 Message Date
Arec Jamgochian
59083ebce3 making option list indexable to visualize in tensorboard. noticing run from last night had much better performance under more long options, unclear if due to choice or environment factors, like episodes lasting longer. making stoponcollision and seed parameters. fixing ability to see reward metrics under ray/tune/, problem was they were being returned as tensors, not floats 2022-02-25 16:36:14 -08:00
Arec Jamgochian
d1f23e6d25 readding expertdata to gitignore, just manually adding expert joint state and action files 2022-02-25 01:27:02 -08:00
Arec Jamgochian
46564231ef changing gitignore to upload expert data for evaluation, adding multiple roundabout trackfile environments in vecenv 2022-02-25 01:21:16 -08:00
Arec Jamgochian
bf9ce84fe4 changing when directory name gets saved 2022-02-25 00:42:44 -08:00
Arec Jamgochian
99aa50a08b added support for different activations, number of hidden layers, options, running a big run over this 2022-02-25 00:00:04 -08:00
Arec Jamgochian
7feea74eb8 adding stablebaselines, adding safe loading for nonCuda cluster 2022-02-24 23:18:02 -08:00
ebuehrle
5a5d8a7aff WIP: Support different plan lengths 2022-02-25 01:32:54 +01:00
ebuehrle
02c1813b00 Incrementing agent expert data, smaller policy network 2022-02-25 01:23:15 +01:00
Johannes Fischer
0d193d4af3 Scratch for horner scheme 2022-02-24 15:12:29 +01:00
Johannes Fischer
8e12996dfe fix typo 2022-02-24 14:18:26 +01:00
ebuehrle
febceed651 Add expert data 2022-02-23 18:17:30 +01:00
Johannes Fischer
a3280893af Update IDM script 2022-02-23 18:16:01 +01:00
ebuehrle
336cf02278 Parameterize hidden layer size of policy, add some candidates to grid search 2022-02-23 18:14:23 +01:00
ebuehrle
7f64ec7bb0 Move hyperparameters to config object
ToDo: parameterize network architectures
2022-02-23 18:00:19 +01:00
ebuehrle
406c4ad9ee Fix tune by moving file 2022-02-23 17:41:41 +01:00
Johannes Fischer
9c3cb4fb55 Add IDM script 2022-02-23 17:21:02 +01:00
ebuehrle
f037c119cc Set up for ray tune 2022-02-23 16:55:13 +01:00
ebuehrle
91f88983b0 Add learning rate schedule to SHAIL-PPO 2022-02-23 14:22:02 +01:00
Johannes Fischer
a1db6aa553 Make IDM use vehicle on ego path a reference 2022-02-22 22:00:46 +01:00
Arec
68b066ec53 adding success rate, total distance, and survive time 2022-02-22 00:48:35 -08:00
Arec
e7f4f6a871 wrapping all environments in timelimit to stop runs longer than 100s, since some others were erroring 2022-02-21 17:54:29 -08:00
Arec
e7f8385628 updating rwse to work at different times, updating correct testing environment from roundabout, removing the assertion that a collision implies done in the evaluator, using nanmean and nanstd in averaging 2022-02-21 15:55:16 -08:00
ebuehrle
daa4825f17 Add GAIL-PPO 2022-02-21 22:21:13 +01:00
ebuehrle
a89317e1d5 Correct checkpoint file path 2022-02-21 22:11:34 +01:00
ebuehrle
b89f5db9d8 Add SHAIL policy with more options 2022-02-21 22:07:44 +01:00
ebuehrle
953a93a541 Add two checkpoints for SHAIL-PPO 2022-02-21 17:33:08 +01:00
ebuehrle
a242edc5d3 Fix predict for reparameterized modules
Better way would probably be to rewrite flat_grad and reparam
2022-02-21 13:29:53 +01:00
ebuehrle
2da0e05782 Implement rwse 2022-02-21 11:05:19 +01:00
Arec
8c4ff03208 adding average absolute delta v, and tracking positions and setting up architecture to implement rwse 2022-02-21 00:06:39 -08:00
Arec
d2932951f6 adding metric saving and averaging over seeds 2022-02-20 23:22:46 -08:00
Arec Jamgochian
a7102a29df Merge pull request #4 from sisl/options
Integrate options env and policy
2022-02-20 20:20:28 -08:00
ebuehrle
ce22516893 Fix imports 2022-02-18 10:18:10 +01:00
ebuehrle
84351e77f2 Add SHAIL-PPO 2022-02-18 06:54:52 +01:00
ebuehrle
1624e1a349 Add SHAIL 2022-02-17 23:51:40 +01:00
ebuehrle
9de6bfe9a3 Add GAIL 2022-02-17 22:58:00 +01:00
ebuehrle
cd58ce2898 Remove old code 2022-02-17 22:43:41 +01:00
ebuehrle
5bd8b42d9f Merge updated files 2022-02-17 22:41:55 +01:00
ebuehrle
b78f95bab5 More checkpoints, adjustments for collision check 2022-02-16 10:19:50 +01:00
ebuehrle
c5e68ca33a Add model checkpoint 2022-02-15 22:01:28 +01:00
ebuehrle
c6a4c10605 Integrate options env and policy 2022-02-15 18:36:53 +01:00
ebuehrle
072c0ff417 Copy files 2022-02-15 14:03:22 +01:00
ebuehrle
a3b9b3e250 Port TRPO, PPO, GAIL 2022-02-15 11:07:08 +01:00
Arec
530ac95d61 Merge branch 'test' into main 2022-02-05 21:50:16 -08:00
Arec
3e6fce42ee BUG FIXES: moving around when policy is loaded, adding BaseAlgorithm abstract classes, correcting metrics, normalizng actions if idm environment is a normalized action one, manually updating environment graph when using idm, implementing idm forward class 2022-02-05 21:48:56 -08:00
Arec
795e1c08b6 adding metric comparisons and updating (note: pre-debug) init 2022-02-04 15:51:17 -08:00
Arec
d1f9e3d7c4 adding main test sequence. must debug and add summary and comparison metric generators tomorrow 2022-02-02 22:29:05 -08:00
Arec
31912416f1 adding pbar to evaluator and making metric save optional, adding typing to baselines 2022-02-02 22:19:40 -08:00
Arec
3ce86b31f7 adding Prop controller and IDMRulePolicy 2022-02-02 15:43:23 -08:00
Arec
3991306da0 updating evaluation wrapper to only store relevant variables during execution 2022-01-31 16:28:13 -08:00
ebuehrle
a60cc18874 PPO lidar + random agent 2022-01-22 08:05:16 +01:00