Skip to main content
GalsenAI

Datasets

Datasets · Multilingue

Corpora in the catalog that cover multilingue, alone or in combination with other languages.

Filter the catalog

Reset · see all 13 datasets

3 datasets in this selection

  • FLORES-200 , Open on Hugging Face (opens in new tab)

    Traduction automatique

    Reference evaluation set for machine translation, covering 200 languages including Wolof. Because the same sentences are translated into every language, it makes it possible to compare a Wolof model against results obtained on better-resourced languages.

    • Wolof
    • Français
    • Anglais
    • Multilingue
    Volume
    200 languages
    License
    CC BY-SA 4.0

    Open on Hugging Face

  • MAFAND-MT , Open on Hugging Face (opens in new tab)

    Traduction automatique

    Parallel translation corpus in the news domain, covering 21 African languages including Wolof, with French and English as pivot languages. Also produced by the Masakhane collective.

    • Wolof
    • Français
    • Anglais
    • Multilingue
    Volume
    21 African languages
    License
    CC BY-NC 4.0

    Open on Hugging Face

  • MasakhaNER 2.0 , Open on Hugging Face (opens in new tab)

    Reconnaissance d'entités

    Named entity recognition corpus covering 20 African languages, including Wolof. Produced by the Masakhane collective, to which GalsenAI members contribute. Annotations cover people, places, organisations and dates.

    • Wolof
    • Multilingue
    Volume
    20 African languages
    License
    AFL 3.0

    Open on Hugging Face