Auto-Markup BenchMark: towards an industry-standard benchmark for evaluating automatic document markup
Published in Balisage: The Markup Conference 2023 — Balisage Series on Markup Technologies, Vol. 28, 2023
We introduce an early benchmark (Auto-Markup BenchMark) for evaluating automatic markup engines and propose XATER (XML Translation Edit Rate) alongside a validation-error metric to standardize comparisons across tools and tasks.
Recommended citation: Prescod, P.; Feuer, B.; Hladkyi, A.; Paulk, S.; Prasad, A. (2023). Auto-Markup BenchMark: towards an industry-standard benchmark for evaluating automatic document markup. Proceedings of Balisage: The Markup Conference 2023, Balisage Series on Markup Technologies, Vol. 28.
Download Paper | Download Bibtex
