The mismatches between calls and implementations of some functions.

[Squirtle-gpj]

Hello,

This benchmark is very nice. But when I want to use it, I find some confusing parts in the code.

For example, in line 221 of paper.py, the code is:

retrace = Retrace(behavior_data, gamma, lamb=.9, max_iters=50)
out0, Q, mapping = retrace.run(pi_b, pi_e, 'retrace', epsilon=.002)

However, in the implementation of the Retrace class (which is located at algos.retrace_lambda.py), the init function is:

def init(self, method, lamb) -> None:

and there is not a function called run in this class.

There are many similar mismatches in this benchmark (like other algo classes), so I want to know whether you could fix this problem.

Best Regards
Pengjie

[clvoloshin]

Please try paper.py on the paper branch. The current master branch has been nearly entirely refactored