OscervaME
/
stable-baselines3-contrib-sacd
2
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
152 Commits 1 Branch 0 Tags 1.1 MiB
Commit Graph

152 Commits

Author SHA1 Message Date
Antonin RAFFIN adfbeb1b01 Fix typo in changelog (#237) 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 17cd797d5c Release v2.3.0 (#236) 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 34eceaf382 Log success rate for PPO variants (#235) 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 89d0113037 Update ruff and SB3 dependencies (#232) 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 7dd6c39fba Fix MaskablePPO type annotations (#233) 
* Fix `sb3_contrib/common/maskable/callbacks.py` type annotations

* Fix `sb3_contrib/common/vec_env/async_eval.py` type annotations

* Fix `sb3_contrib/common/maskable/buffers.py` type hints

* Fix `sb3_contrib/common/maskable/distributions.py` type hints

* Fix `sb3_contrib/common/maskable/policies.py` type hints

* Fix `sb3_contrib/ppo_mask/ppo_mask.py` type hints

* Update changelog and fix type hints
 2024-05-06 14:20:28 +01:00
Armand du Parc Locmaria cd31e89e26 Fix `train_freq` type annotation for TQC and QR-DQN (#229) 
* fix train_freq type for tqc and qrdn

* fix typo

* Update changelog

---------

Co-authored-by: Antonin Raffin <antonin.raffin@dlr.de>
 2024-05-06 14:20:28 +01:00
Tjeerd Bakker bc3c0a9595 Add notes about MaskablePPO (#227) 
* Add note about MaskableEvalCallback

* Update doc

---------

Co-authored-by: Antonin Raffin <antonin.raffin@dlr.de>
 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 3f0c5088b3 Update QRDQN defaults (#225) 2024-05-06 14:20:28 +01:00
Rogério Júnior 1553b66ee4 Update `_process_sequence()` docstring (#219) 
Small modification in the documentation of `_process_sequence` to reflect the correct order (`hidden_state`, `cell_state`) of `lstm_states`.

See order here: https://pytorch.org/docs/stable/generated/torch.nn.LSTM.html
 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 94a5daab02 Update SB3 version (#217) 2024-05-06 14:20:28 +01:00
Antonin RAFFIN ebb74c44ec Release v2.2.0 (#216) 2024-05-06 14:20:28 +01:00
Antonin Raffin 6cfa588c0f Update pytorch version 2024-05-06 14:20:28 +01:00
Antonin RAFFIN c965ba9d3b Remove PyType and upgrade to latest SB3 version (#215) 2024-05-06 14:20:28 +01:00
M. Ernestus 5e437fc4dc Add rollout_buffer_class to TRPO (#214) 
* Add rollout_buffer_class and rollout_buffer_kwargs to TRPO

* Update requirements and changelog

---------

Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
 2024-05-06 14:20:28 +01:00
Antonin RAFFIN 4d7ed004af Sync SB3 Contrib with SB3 (#213) 
* Update RTD config

* Switch to ruff for sorting imports

* Evaluate falsy to truthy with not rather than `is False`

* Add `features_extractor` argument to maskable policy

* Add set_options for AsyncEval

* Doc fixes
 2024-05-06 14:20:28 +01:00
Antonin Raffin 5be11deaf3 Fix RTD default theme 2024-05-06 14:20:28 +01:00
Antonin RAFFIN cf4ed5fe65 Release v2.1.0 (#204) 
* Release v2.1.0

* Fix mypy

* Fix warnings in tests
 2024-05-06 14:20:28 +01:00
Paul Auerbach 4e99b74e90
Merge branch 'Stable-Baselines-Team:master' into master 2023-08-07 14:34:38 +02:00
Paul Auerbach bc08ee985e Added save_load test for SACD 2023-08-07 14:23:07 +02:00
Paul Auerbach d97dbc727c Added doc page for SACD 2023-08-07 14:03:12 +02:00
Paul Auerbach 610fd3dcf6 Added run test for SACD 2023-08-07 13:16:00 +02:00
Paul Auerbach fca2c6d490 Prepared files for merge request (minor cleanup) 2023-08-04 18:19:34 +02:00
Paul Auerbach 4a37f58259 Code style changes 2023-08-02 13:52:40 +02:00
Paul Auerbach 7711813dbb Reworked code to work whith more than 2 critic networks 2023-08-02 13:17:22 +02:00
Paul Auerbach 875b8bca0d Fixed bugs in that lead to wrong results, currently only working with 2 
critics
 2023-08-01 15:09:55 +02:00
PatrickHelm dfa23bdf9c
Bugfix/ppo mask stats window size (#199) 
* fixes issue #198 regarding stats_window_size

* updates changelog

* updates test of stats_window_size

* updates test using maskable env

* removes print statement
 2023-08-01 11:53:27 +02:00
Paul Auerbach a14ae69b6b Added first version of SAC Discrete, which is running but not learning 
currently
 2023-07-31 16:07:08 +02:00
Antonin RAFFIN 35f06254ba
Drop python 3.7, add 3.11 and update github templates (#194) 
* Update issue templates

* Update supported python versions

* Update min PyTorch version

* Skip pytype for py311

* Update conda env for doc
 2023-07-03 12:45:20 +02:00
Antonin RAFFIN de92025bb2
Prepare Release v2.0 (#192) 2023-06-23 13:10:17 +02:00
Antonin RAFFIN 6e1aba45e3
Update version and fix #188 (#190) 2023-06-07 16:51:42 +02:00
Antonin Raffin c84079d4f3 Update pypi build command 2023-05-24 11:41:28 +02:00
Antonin RAFFIN d467d7a844
Update AsyncEval seeding (#185) 
* Update AsyncEval seeding

* Update random seed in tests
 2023-05-20 10:57:31 +02:00
Antonin RAFFIN 86fb056fda
Update doc: switch from Gym to Gymnasium (#182) 
* Update documentation to switch to Gymnasium

* Fix custom env type hints

* Fix type check
 2023-05-10 11:40:40 +02:00
Antonin RAFFIN 21cc96cafd
Add Gymnasium support (#152) 
* Add support for Gym 0.24

* Fixes for gym 0.24

* Fix for new reset signature

* Add tmp SB3 branch

* Fixes for gym 0.26

* Remove unused import

* Fix dependency

* Type annotations fixes

* Reformat

* Reformat with black 23

* Move to gymnasium

* Patch env if needed

* Fix types

* Fix CI

* Fixes for gymnasium

* Fix wrapper annotations

* Update version

* Fix type check

* Update QRDQN type hints and bug fix with multi envs

* Fix TQC type hints

* Fix TRPO type hints

* Additional fixes

* Update SB3 version

* Update issue templates and CI

---------

Co-authored-by: Quentin Gallouédec <45557362+qgallouedec@users.noreply.github.com>
 2023-04-14 13:52:07 +02:00
Antonin RAFFIN a84ad3aa7d
Release v1.8.0 (#173) 2023-04-08 15:50:04 +02:00
Jonas Reiher aacded79c5
Add stats window argument (#171) 
* added missing tensorboard_log docstring

* added stats_window_size argument to all models

* changelog updated

* Update SB3 version

* fixed passing stats_window_size to parent

* added test of stats_window_size

---------

Co-authored-by: Antonin Raffin <antonin.raffin@dlr.de>
 2023-04-05 18:47:27 +02:00
Antonin RAFFIN ce115982aa
Fix QR-DQN type hints (#170) 2023-03-30 11:50:26 +02:00
Antonin RAFFIN b5fd6e65ba
Update SB3 and config (#167) 2023-03-20 12:35:37 +01:00
Antonin RAFFIN 1f9568b2da
Fix Atari Roms Download (#164) 2023-03-12 19:06:23 +01:00
Antonin RAFFIN 728c1c5b7f
Issue forms and pyproject.toml (#162) 
* Issue forms and pyproject.toml

* [ci skip] Fix typos

* Fix isort config

* Use secret link to download atari roms

* Fix for mypy and update config

* Upgrade SB3 and fix warnings

* Fix doc build

* Update Makefile

* Lint first
 2023-03-11 22:57:45 +01:00
Alex Pasquali 376d9551de
Update MaskablePPO docs (#150) 
* MaskablePPO docs

Added a warning about possible crashes caused by chack_env in case of invalid actions.

* Reformat with black 23

* Rephrase note on action sampling

* Fix action noise

* Update changelog

---------

Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
 2023-02-13 14:31:49 +01:00
Alex Pasquali 6bc8e426bf
Removed shared layers in mlp_extractor (#137) 
* Removed shared layers in mlp_extractor

* Add ruff

* Update version and add warning

Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
 2023-01-25 16:28:27 +01:00
Antonin Raffin 1d0edd2dab
Move pytype to pyproject.toml 2023-01-10 22:55:12 +01:00
Antonin RAFFIN 7bf9cf3f3a
Release v1.7.0 (#134) 2023-01-10 22:35:18 +01:00
Alex Pasquali b5aa9a47ce
Deprecation of shared layers in `mlp_extractor` (#133) 
* Deprecation of shared layers in mlp_extractor

* Fix missing import

* Reformat and update tests

Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
 2023-01-05 10:42:22 +01:00
Quentin Gallouédec 7c4a249fa4
Standardize the use of ``from gym import spaces`` (#131) 
* Standardize from gym import spaces

* update changelog

* update issue template

* update version

* Update version
 2023-01-02 15:35:00 +01:00
Quentin Gallouédec c9bd045d5c
Add support for python3.10 (#129) 
Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
 2022-12-23 00:54:35 +01:00
Quentin Gallouédec 9cf8b5076f
Construct tensors directly on GPUs (#128) 
* `to(device)` to `device=device` and `float()` to `dtype=th.float32`

* Update changelog

* Fix type checking

Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
 2022-12-23 00:44:25 +01:00
Alex Pasquali ab8684f469
[Feature] Non-shared features extractor in on-policy algorithms (#130) 
* Modified sb3_contrib/common/maskable/policies.py

- Added support for non-shared features extractor in file sb3_contrib/common/maskable/policies.py
- updated changelog

* Modified sb3_contrib/common/recurrent/policies.py

* Modified sb3_contrib/qrdqn/policies.py and sb3_contrib/tqc/policies.py

* Updated test_cnn.py

* Upgrade SB3 version

* Revert changes in formatting

* Remove duplicate normalize_images

* Add test for image-like inputs

* Fixes and add more tests

* Update SB3 version

* Fix ARS warnings

Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
 2022-12-23 00:23:45 +01:00
Quentin Gallouédec 6b23c6cfe3
Add `with_bias` parameter to `ARSPolicy` and fix `sb3_contrib/ars/policies.py` type hint (#122) 
* Update contribution.md

* New loop struct to make mypy happy

* Update setup.cfg

* Update changelog

* fix squash_output = False in ARS policy

* Add with_bias parameter to ARSPolicy

* Make ARSLinearPolicy a special case of ARSPolicy

* Remove ars_policy from mypy exclude

* Update changelog

* Update SB3 version

* Fix to save ARS linear policy saved with sb3-contrib < 1.7.0

* Fix test

* Turn docstring into comment

Co-authored-by: Antonin Raffin <antonin.raffin@ensta.org>
Co-authored-by: Antonin Raffin <antonin.raffin@dlr.de>
 2022-12-12 13:22:09 +01:00