#

glotlid

Here are 5 public repositories matching this topic...

cisnlp / GlotLID

[EMNLP 2023] 💬 Language Identification with Support for More Than 2000 Labels

language-detection multlingual language-detector language-recognition glot lid language-identification language-classification language-identification-toolkit low-resource-languages language-detection-library language-identifier language-detection-lib langid low-resource-nlp glotcc glotlid

Updated Apr 15, 2026
Python

cisnlp / GlotCC

[NeurIPS 2024] 🕸 GlotCC Dataset and Pipline

crawler multlingual corpus-linguistics glot language-identification commoncrawl common-crawl glotcc multilingual-dataset glotlid

Updated Apr 6, 2025
Jupyter Notebook

cisnlp / ungoliant

🕷️ The pipeline for the OSCAR/GlotCC corpus

glotcc glotlid

Updated Oct 23, 2024
Rust

cisnlp / oscar-tools

The original tooling for the GlotCC/OSCAR corpus rewritten in Rust

glotcc glotlid

Updated Oct 23, 2024
Rust

cisnlp / oscar-io

Readers/Writers for GlotCC/OSCAR corpus

glotcc glotlid

Updated Oct 23, 2024
Rust

Improve this page

Add a description, image, and links to the glotlid topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the glotlid topic, visit your repo's landing page and select "manage topics."