Reference of source document

It seems that NONE of the languages have sources to the data.json 3-gram model. Is it possible to provide document sources for each language such that we can review the material, and possibly generate 2-grams and 4-grams (or 2/3 or 3/4 or 2/3/4-gram combos) models?

[DonaldTsang]

BTW I think we can possibly improvise with any collection of fictional and religious books, when we are provided a tool to remove proper nouns from such works to leave in common word structures. Problem: copyright. See: The Bible

• https://www.babbel.com/en/magazine/most-translated-books/
• https://ingcointernational.com/the-20-most-translated-texts-in-history/

BTW here is something unique https://github.com/pemistahl/lingua#4--how-good-is-it-top- Also these three uses Wikipedia as base:

• https://github.com/optimaize/language-detector
• https://github.com/shuyo/language-detection
• https://github.com/Mimino666/langdetect
• anything that uses code.google.com/p/language-detection

There are also others who use http://wortschatz.uni-leipzig.de/en/download/ and even more exotic, https://github.com/google/corpuscrawler and with tweets, https://github.com/mitjat/langid_eval

https://github.com/davidjurgens/equilid#model-details is even more comprehensive But https://github.com/landrok/language-detector basically has a hidden dataset

[DonaldTsang]

Okay, thanks for the help.