camembertav2-base-name-classifier-v2

camembertav2-base-name-classifier-v2

This model is a fine-tuned version of almanach/camembertav2-base on ele-sage/person-company-names-classification dataset.

It achieves the following results on the evaluation set:

• Loss: 0.0215
• Accuracy: 0.9942
• Precision: 0.9985
• Recall: 0.9910
• F1: 0.9947

Model description

This model is a high-performance binary text classifier, fine-tuned from camembertav2-base. Its purpose is to distinguish between a person's name and a company/organization name with high accuracy.

Direct Use

This model is intended to be used for text classification. Given a string, it will return a label indicating whether the string is a Person or a Company.

from transformers import pipeline

classifier = pipeline("text-classification", model="ele-sage/camembertav2-base-name-classifier-v2")

results = classifier([
    "Satya Nadella",
    "Global Innovations Inc.",
    "Martinez, Alonso"
])

for result in results:
    print(f"Text: '{result['text']}', Prediction: {result['label']}, Score: {result['score']:.4f}")

Downstream Use

This model is a key component of a two-stage name processing pipeline. It is designed to be used as a fast, efficient "gatekeeper" to first identify person names before passing them to a more complex parsing model, such as ele-sage/distilbert-base-uncased-name-splitter.

Out-of-Scope Use

• This model is not a general-purpose classifier. It is highly specialized for distinguishing persons from companies and will not perform well on other classification tasks (e.g., sentiment analysis).

Bias, Risks, and Limitations

• Geographic & Cultural Bias: The training data is heavily biased towards North American (Canadian) person names and Quebec-based company names. The model will be less accurate when classifying names from other cultural or geographic origins.
• Ambiguity: Certain names can legitimately be both a person's name and a company's name (e.g., "Ford"). In these cases, the model makes a statistical guess based on its training data, which may not always align with the specific context.
• Data Source: The person name data is derived from a Facebook data leak and contains noise. While a rigorous cleaning process was applied, the model may have learned from some spurious data.

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1e-05
• train_batch_size: 128
• eval_batch_size: 128
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 1000
• num_epochs: 1

Training results

Framework versions

• Transformers 4.57.1
• Pytorch 2.9.0+cu128
• Datasets 4.4.1
• Tokenizers 0.22.1