812648e6cd
Rename QRDQN logger key ( #67 )
2022-04-12 12:50:35 +02:00
99853265a9
Using policy_aliases instead of register_policy ( #66 )
...
* Using policy_aliases instead of register_policy
* Moving policy_aliases definitions
* Update SB3 version
Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
2022-04-08 21:36:23 +02:00
901a648507
Upgrade Gym to 0.21 ( #59 )
...
* Pendulum-v0 -> Pendulum-v1
* Reformat with black
* Update changelog
* Fix dtype bug in TimeFeatureWrapper
* Update version and removed forward calls
* Update CI
* Fix min version
Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
2022-02-22 16:25:43 +01:00
a1b5ea67ae
Multiprocessing support for off policy algorithms ( #50 )
...
* TQC support for multienv
* Add optional layer norm for TQC
* Add layer nprm for all policies
* Revert "Add layer nprm for all policies"
This reverts commit 1306c3c64eb12613464982c66cb416a3bbc66285.
* Revert "Add optional layer norm for TQC"
This reverts commit 200222e3a8878007aa6032d540ae74274a4d0788.
* Add experimental support to train off-policy algorithms with multiple envs
* Bump version
* Update version
2021-12-02 10:40:21 +01:00
cd0a5e516f
Update citation ( #54 )
...
* Update citation
* Fixes for new SB3 version
* Fix type hint
* Additional fixes
2021-12-01 19:09:32 +01:00
b2e7126840
Train/Eval Mode Support ( #39 )
...
* switch models between train and eval mode
* update changelog
* update release in change log
* Update dependency
Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
2021-09-08 12:54:50 +02:00
2258c72215
Update to new logger ( #32 )
2021-06-14 17:25:08 +02:00
3665695d1e
Dictionary Observations ( #29 )
...
* Add TQC support for new HER version
* Add dict obs support
* Add support for dict obs
2021-05-11 13:24:31 +02:00
9824daca44
Bug fix for QR-DQN ( #21 )
...
* Bug fix for QR-DQN
* Upgrade SB3
2021-03-06 14:54:43 +01:00
74e60381a6
Upgrade Stable-Baselines3 ( #19 )
...
* Upgrade Stable-Baselines3
* Fix policy saving/loading
2021-02-27 18:17:22 +01:00
4b4d487fdb
Fix the target calculation of QR-DQN ( #18 )
...
* Fix the target calculation of QR-DQN
* Update doc
* Update version
* Update changelog
* Update README
Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
2021-01-11 14:11:16 +01:00
b30397fff5
Add QR-DQN ( #13 )
...
* Add QR-DQN(WIP)
* Update docstring
* Add quantile_huber_loss
* Fix typo
* Remove unnecessary lines
* Update variable names and comments in quantile_huber_loss
* Fix mutable arguments
* Update variable names
* Ignore import not used warnings
* Fix default parameter of optimizer in QR-DQN
* Update quantile_huber_loss to have more reasonable interface
* update tests
* Add assertion to quantile_huber_loss
* Update variable names of quantile regression
* Update comments
* Reduce the number of quantiles during test
* Update comment
* Update quantile_huber_loss
* Fix isort
* Add document of QR-DQN without results
* Update docs
* Fix bugs
* Update doc
* Add comments about shape
* Minor edits
* Update comments
* Add benchmark
* Doc fixes
* Update doc
* Bug fix in saving/loading + update tests
Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
2020-12-21 11:17:48 +01:00
Antonin RAFFIN
Grégoire Passault
Adam Gleave
Scott Brownlie
Toshiki Watanabe