Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

BLEU Score Computation

See original GitHub issue

I have two questions:

How do you compute the reported BLEU scores? I see the imports of BLEU in several models but BLEU is never added to the self.metrics collection of any of them.
When computing BLEU, which sentences are considered to be references?

Issue Analytics

State:
Created 5 years ago
Comments:6

Top GitHub Comments

3reactions

sleighsoftcommented, Oct 25, 2018

@Yaoming95 I would really love to replicate your results.

0reactions

xuefeng199507commented, Dec 20, 2020

@Yaoming95 I would really love to replicate your results.

Have you solved the problem? 😃

Hello, I encountered the same problem as you, please tell me how you solved it?Thanks

Top Results From Across the Web

A Gentle Introduction to Calculating the BLEU Score for Text in ...

We first compute the n-gram matches sentence by sentence. Next, we add the clipped n-gram counts for all the candidate sentences and divide...

BLEU — Bilingual Evaluation Understudy | by Renu Khandelwal

BLEU compares the n-gram of the candidate translation with n-gram of the reference translation to count the number of matches. These matches are ......

How to calculate BLEU Score in Python? - DigitalOcean

The BLEU score compares a sentence against one or more reference sentences and tells how well does the candidate sentence matched the list...

BLEU - Wikipedia

Scores are calculated for individual translated segments—generally sentences—by comparing them with a set of good quality reference translations.

Bilingual Evaluation Understudy (BLEU) - Lei Mao's Log Book

Usually, BLEU uses N=4 N = 4 and wn=1N w n = 1 N . Example 1. We have computed the modified precision...