Code

Feature/extension collector buffer#1196

Code

Merged

MischaPanch merged 39 commits intomasterthu-ml/tianshou:masterfrom feature/extension-collector-bufferthu-ml/tianshou:feature/extension-collector-bufferCopy head branch name to clipboardAug 20, 2024

+1,976-651

Commits

Commits on Aug 1, 2024

• TrainingStats: fix for zero-len sequences, fixed an optional type

  Show description for e1709f0
  

  Michael Panchenko

  committed
  e1709f0

  Copy full SHA for e1709f0

• Rliable eval: multiple extensions

  Show description for e41deca
  

  Michael Panchenko

  committed
  e41deca

  Copy full SHA for e41deca

• Added WandbLoggerFactory, made config_dict optional

  

  Michael Panchenko

  committed
  9ceb041

  Copy full SHA for 9ceb041

• Logging: made restore_logged_data static. Eval: better use of DataScope

  Show description for c492765
  

  Michael Panchenko

  committed
  c492765

  Copy full SHA for c492765

• Spelling [ci skip]

  

  Michael Panchenko

  committed
  547b626

  Copy full SHA for 547b626

Commits on Aug 4, 2024

• Merge branch 'master' into feature/enhanced-rliable-eval

  MischaPanch

  authored
  bd58804

  Copy full SHA for bd58804

Commits on Aug 5, 2024

• Minor typing and docstrings [ci skip]

  

  Michael Panchenko

  committed
  f18f4a4

  Copy full SHA for f18f4a4

Commits on Aug 7, 2024

• New util: create_uniform_action_dist

  

  Michael Panchenko

  committed
  434606d

  Copy full SHA for 434606d

• HL, config: option to collect n_episodes, post-init validation, docstrings

  Show description for 0a3fc25
  

  Michael Panchenko

  committed
  0a3fc25

  Copy full SHA for 0a3fc25

• n-step-return: better variable names, more docstrings and comments

  

  Michael Panchenko

  committed
  a95a8b1

  Copy full SHA for a95a8b1

• Merge branch 'refs/heads/thuml-master' into feature/extension-collector-buffer

  Show description for 47a2a5a
  

  Michael Panchenko

  committed
  47a2a5a

  Copy full SHA for 47a2a5a

Commits on Aug 8, 2024

• Fixup returns

  

  Michael Panchenko

  committed
  29bc77a

  Copy full SHA for 29bc77a

• Test: minor comment

  

  Michael Panchenko

  committed
  6abfefc

  Copy full SHA for 6abfefc

• Major commit to ReplayBuffer and related classes

  Show description for 8dac5b1
  

  Michael Panchenko

  committed
  8dac5b1

  Copy full SHA for 8dac5b1

• Minor formatting, typing

  

  Michael Panchenko

  committed
  d9842e8

  Copy full SHA for d9842e8

• PPO, Changed implementation detail! Important!

  Show description for 3193d61
  

  Michael Panchenko

  committed
  3193d61

  Copy full SHA for 3193d61

• SAC: minor refactoring (extracted correct_log_prob_gaussian_tanh)

  

  Michael Panchenko

  committed
  dfac7ad

  Copy full SHA for dfac7ad

• Trainer: multiple small enhancements

  Show description for e9d1b68
  

  Michael Panchenko

  committed
  e9d1b68

  Copy full SHA for e9d1b68

• Collector: major extension and some refactoring

  Show description for da3a299
  

  Michael Panchenko

  committed
  da3a299

  Copy full SHA for da3a299

• Minor, typing

  

  Michael Panchenko

  committed
  404134b

  Copy full SHA for 404134b

• Merge branch 'master' into feature/extension-collector-buffer

  MischaPanch

  authored
  a9eda24

  Copy full SHA for a9eda24

• Imports, docs

  

  Michael Panchenko

  committed
  d6e3d0a

  Copy full SHA for d6e3d0a

Commits on Aug 9, 2024

• Trainer: don't rely on progress bar for terminating loops

  

  Michael Panchenko

  committed
  9bd17be

  Copy full SHA for 9bd17be

Commits on Aug 10, 2024

• Collector: improved rollout hooks interfaces and docstrings

  Show description for 0bb8e9c
  

  Michael Panchenko

  committed
  0bb8e9c

  Copy full SHA for 0bb8e9c

• Removed no longer needed array module

  

  Michael Panchenko

  committed
  4d81520

  Copy full SHA for 4d81520

• Aesthetic: docstrings, var names

  

  Michael Panchenko

  committed
  90d3959

  Copy full SHA for 90d3959

• Merge branch 'refs/heads/thuml-master' into feature/extension-collector-buffer

  Show description for 56e0b3c
  

  Michael Panchenko

  committed
  56e0b3c

  Copy full SHA for 56e0b3c

Commits on Aug 18, 2024

• Collector: use a larger default buffer size (previous default didn't make sense)

  

  Michael Panchenko

  committed
  f6134d2

  Copy full SHA for f6134d2

• Batch: possibility to get len of batches with dist. Added a test

  

  Michael Panchenko

  committed
  872183e

  Copy full SHA for 872183e

• Test env: aesthetic

  

  Michael Panchenko

  committed
  8a0f536

  Copy full SHA for 8a0f536

• Buffer: better names for vars (no functional change)

  

  Michael Panchenko

  committed
  9997f8c

  Copy full SHA for 9997f8c

• Collector: major extension that allows customizing how collection stats are computed

  Show description for 64cdf14
  

  Michael Panchenko

  committed
  64cdf14

  Copy full SHA for 64cdf14

• Typing: since Collector generic, CollectStats need to be passed at init for mypi

  

  Michael Panchenko

  committed
  58879cb

  Copy full SHA for 58879cb

• Merge branch 'refs/heads/thuml-master' into feature/extension-collector-buffer

  

  Michael Panchenko

  committed
  a1453b8

  Copy full SHA for a1453b8

• Merge branch 'refs/heads/thuml-master' into feature/extension-collector-buffer

  Show description for 463d818
  

  Michael Panchenko

  committed
  463d818

  Copy full SHA for 463d818

• nb-clean

  

  Michael Panchenko

  committed
  5098d32

  Copy full SHA for 5098d32

• Typos [ci skip]

  

  Michael Panchenko

  committed
  419f3c5

  Copy full SHA for 419f3c5

Commits on Aug 20, 2024

• Collector, fixed omission: make use of raise_on_nan_in_buffer

  

  Michael Panchenko

  committed
  0a65552

  Copy full SHA for 0a65552

• Block comment [ci skip]

  

  Michael Panchenko

  committed
  bd58581

  Copy full SHA for bd58581