You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@inproceedings{bhandari-etal-2020-evaluating,
title = "Re-evaluating Evaluation in Text Summarization",
author = "Bhandari, Manik and
Gour, Pranav Narayan and
Ashfaq, Atabak and
Liu, Pengfei and
Neubig, Graham",
booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
month = nov,
year = "2020",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2020.emnlp-main.751",
doi = "10.18653/v1/2020.emnlp-main.751",
pages = "9347--9359",
abstract = "Automated evaluation metrics as a stand-in for manual evaluation are an essential part of the development of text-generation tasks such as text summarization. However, while the field has progressed, our standard metrics have not {--} for nearly 20 years ROUGE has been the standard evaluation in most summarization papers. In this paper, we make an attempt to re-evaluate the evaluation method for text summarization: assessing the reliability of automatic metrics using top-scoring system outputs, both abstractive and extractive, on recently popular datasets for both system-level and summary-level evaluation settings. We find that conclusions about evaluation metrics on older datasets do not necessarily hold on modern datasets and systems. We release a dataset of human judgments that are collected from 25 top-scoring neural summarization systems (14 abstractive and 11 extractive).",
}
The bib entry from the conversion tool is this:
@InProceedings{BaGALN20,
Address = {Online},
Author = { Bh and Manik ari and Pranav Narayan Gour and Atabak Ashfaq and Pengfei Liu and Graham Neubig},
Booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)},
Doi = {10.18653/v1/2020.emnlp-main.751},
Month = {Nov},
Pages = {9347--9359},
Publisher = {Association for Computational Linguistics},
Title = {{Re-evaluating Evaluation in Text Summarization}},
Url = {https://aclanthology.org/2020.emnlp-main.751},
Year = {2020}
}
Somehow the first author's name got messed up. Changing the last name from "Bhandari" to "Bhand" causes an exception in the code. "Bhan" gives the intended result.
The text was updated successfully, but these errors were encountered:
Here is a bib entry from ACL:
The bib entry from the conversion tool is this:
Somehow the first author's name got messed up. Changing the last name from "Bhandari" to "Bhand" causes an exception in the code. "Bhan" gives the intended result.
The text was updated successfully, but these errors were encountered: