Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] IMPALA-style actor-learner parallelism for DQN variants #477

Open
wants to merge 37 commits into
base: master
Choose a base branch
from
Open

[WIP] IMPALA-style actor-learner parallelism for DQN variants #477

wants to merge 37 commits into from

Conversation

muupan
Copy link
Member

@muupan muupan commented Jun 11, 2019 •
edited
Loading

Merge #436 first.

muupan added 30 commits May 10, 2019 03:07
@muupan
tmp
47480ff
@muupan
Merge branch 'add-env-id-to-replay-buffer' into actor-learner-dqn
539e25a
@muupan
Implement actor-learner parallelism
bca85c9
@muupan
Fix a bug of not shaaring models
e7c816b
@muupan
Rename
091237f
@muupan
Add tests
e88ad5a
@muupan
Make tests pass
d9ab261
@muupan
Merge branch 'recurrent-dqn' into actor-learner-dqn
174f43d
@muupan
Record statistics in loss computation
d3c64e5
@muupan
Remove process_idx from messages
027a208
@muupan
Support recurrent in actor-learner training
5dcf397
@muupan
Restore unintentionally deleted update
ca35585
@muupan
Restore unintentionally deleted stop_current_episode
a635b07
@muupan
Support actor-learner training in IQN
04101b3
@muupan
Add a missing file
c1567cb
@muupan
Record q for IQN
2296f5c
@muupan
Forward quantile_thresholds_K
1ef7860
@muupan
Support copy_param between different devices
4f5a9f1
@muupan
Set OMP_NUM_THREADS=1
4d38460
@muupan
Rename function
f97903f
@muupan
Use poller thread to parallelize learning and polling
3e77935
@muupan
Use replay_buffer_lock in IQN as well
5a3cf6d
@muupan
Support mixing cpu and gpu recurrent states
339b701
@muupan
Use pipes only
c895d7c
@muupan
Merge branch 'actor-learner-dqn' into muupan/actor-learner-dqn-poller
6bd4305
@muupan
Add StoppableThread
00a5b4a
@muupan
Modify actor-learner interface to accept n_updates
b6c6b53
@muupan
Update example as well
e68611d
@muupan
Merge branch 'master' into actor-learner-dqn-poller
39dae2d
@muupan
Call device.use in case gpu>=1
7d48c04
@muupan muupan mentioned this pull request Jun 19, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@muupan