Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inf log-probs when using score.py #45

Open
zhangdongxu opened this issue Jan 24, 2016 · 3 comments
Open

Inf log-probs when using score.py #45

zhangdongxu opened this issue Jan 24, 2016 · 3 comments

Comments

@zhangdongxu
Copy link

Meet this issue when implement score.py. And all the log-probs are inf.
I test this on the training data, where in the training process, most target sentences can be recovered.
In my opinion, zero probability should not exist since in the softmax, there is inner product between two vector.
Any suggestions?

@nouiz
Copy link

nouiz commented Jan 25, 2016

Just to tell you that this repo isn't maintained anymore. See the warning
on this page:

https://github.com/lisa-groundhog/GroundHog

I'm not sure someone else will reply. There is another project that you can
use instead of groundhog that is based on Theano.

On Sat, Jan 23, 2016 at 11:07 PM, zhangdongxu [email protected]
wrote:

Meet this issue when implement scorepy And all the log-probs are inf
I test this on the training data, where in the training process, most
target sentences can be recovered
In my opinion, zero probability should not exist since in the softmax,
there is inner product between two vector
Any suggestions?


Reply to this email directly or view it on GitHub
#45.

@zhangdongxu
Copy link
Author

Thank you. I notice that. But I concerned that has attention-based structure been employed in Block's translation system?

@rizar
Copy link

rizar commented Jan 25, 2016

Yes, the implementation in Blocks uses attention.

On 25 January 2016 at 08:41, zhangdongxu [email protected] wrote:

Thank you. I notice that. But I concerned that has attention-based
structure been employed in Block's translation system?


Reply to this email directly or view it on GitHub
#45 (comment)
.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants