wowsuch ai
Live

nlpai-labModel

MixLID

MixLID is a token-classification model for identifying languages in monolingual and mixed-language text. It supports 111 language labels and provides token-level spans as well as a predominant-language prediction for an input.

What it does

Use it to identify language spans in mixed-language documents or transcripts, filter multilingual data, and evaluate language consistency in generated text.

Availability
Published Hugging Face model ID and Hugging Face Space demo
Pricing model
Not established
Deployment
Model can be downloaded and run with Transformers or the local MixLID module
Privacy
Not established
Licence
MIT
Capability
extractionanalysis
Modality
text
Access
open weightsweb
Deployment
on-premises
Pricing
unknown
Target user
developerresearcher

Evidence

5 claims
  • MixLID supports 111 language labels. [1]
    It supports **111 language labels** and returns both **language spans** and **one predominant language per input**.
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • It provides token-level predictions and a predominant-language prediction for an input. [1]
    | Prediction modes | Token-level predictions and predominant input language |
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • Token predictions include language labels, character offsets, and scores. [1]
    | Output details | Language labels, character offsets, and prediction scores |
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • A Hugging Face Space demo is available. [1]
    **Demo:** [Hugging Face Space](https://huggingface.co/spaces/hongst/MixLID)
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.
  • The published model can be loaded using Transformers or the local MixLID module. [1]
    Load the downloaded model directory, or replace `"./MixLID"` with the published Hugging Face model ID:
    Hugging Face. Quoted text is outside CC BY 4.0 and keeps its original rights.

Sources

1
1
Hugging FaceOwner-controlled
https://huggingface.co/nlpai-lab/MixLID Retrieved 2026-10-29 00:08 UTC
Verified

Versions

3
VersionEffectiveChangeChanged fieldsState
32026-10-14 14:25 UTCmaterial changeaccess, availability, deploymentCurrent
22026-10-13 15:16 UTCmaterial changeavailability, deploymentCurrent
12026-10-12 16:06 UTCpublicationNoneCurrent

In briefs

1

Open in the catalog

Original catalog content is licensed under CC BY 4.0, attributed to wowsuchai. Source quotations and linked content keep their original rights.