Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem of reproduce. #9

Open
shizizuoing opened this issue Oct 26, 2023 · 1 comment
Open

Problem of reproduce. #9

shizizuoing opened this issue Oct 26, 2023 · 1 comment

Comments

@shizizuoing
Copy link

Hello author, I have tried to reproduce this article many times, but have all received very low results. I have a few questions and hope to receive your results. I saw that the weight attenuation in your paper is 0.7, so I changed it to 0.7. No other hyperparameters have been modified. May I ask if this modification is correct? The result I obtained is similar to the image, which is different from the paper's result. This problem has puzzled me for a long time, and I hope to receive your help.
image

@Chen-Yang-Liu
Copy link
Owner

Hello author, I have tried to reproduce this article many times, but have all received very low results. I have a few questions and hope to receive your results. I saw that the weight attenuation in your paper is 0.7, so I changed it to 0.7. No other hyperparameters have been modified. May I ask if this modification is correct? The result I obtained is similar to the image, which is different from the paper's result. This problem has puzzled me for a long time, and I hope to receive your help. image

Your modification is okay. You can try setting "--beam_size" to 3 and select the best model to run eval.py to get the metric. Besides, you can refer to this issue and try using our published model on your device to see if the score is normal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants