Word2Bezbar-large

Word2Bezbar: Word2Vec Models for French Rap Lyrics

Overview

Word2Bezbar are Word2Vec models trained on french rap lyrics sourced from Genius. Tokenization has been done using NLTK french word_tokenze function, with a prior processing to remove french oral contractions. Used dataset size was 323MB, corresponding to 77M tokens.

The model captures the semantic relationships between words in the context of french rap, providing a useful tool for studies associated to french slang and music lyrics analysis.

Model Details

Size of this model is large

Versions

This model has been trained with the followed software versions

Installation

1. Install Required Python Libraries:

   pip install gensim
   

2. Clone the Repository:

   git clone https://github.com/rapminerz/Word2Bezbar-large.git
   

3. Navigate to the Model Directory:

   cd Word2Bezbar-large
   

Loading the Model

To load the Word2Bezbar Word2Vec model, use the following Python code:

import gensim

# Load the Word2Vec model
model = gensim.models.Word2Vec.load("word2vec.model")

Using the Model

Once the model is loaded, you can use it as shown:

1. To get the most similary words regarding a word

model.wv.most_similar("bendo")
[('binks', 0.7082766890525818),
 ('bando', 0.684855043888092),
 ('tieks', 0.664956271648407),
 ('hall', 0.6226587295532227),
 ('ghetto', 0.6097022294998169),
 ('barrio', 0.5864858627319336),
 ('hood', 0.5714126229286194),
 ('block', 0.5666197538375854),
 ('quartier', 0.557117760181427),
 ('bloc', 0.5540688037872314)]

model.wv.most_similar("kichta")
[('liasse', 0.7318882942199707),
 ('sse-lia', 0.7186722755432129),
 ('kishta', 0.6604368686676025),
 ('kich', 0.6188479661941528),
 ('moula', 0.570914626121521),
 ('sacoche', 0.553415834903717),
 ('skalape', 0.5243070125579834),
 ('Kichta', 0.49806657433509827),
 ('ppe-fra', 0.49229520559310913),
 ('valise', 0.49089524149894714)]

1. To find the word that doesn't match in a list of words

model.wv.doesnt_match(["racli","gow","gadji","fimbi","boug"])
'boug'

model.wv.doesnt_match(["Zidane","Mbappé","Ronaldo","Messi","Jordan"])
'Jordan'

1. To find the similarity between two words

model.wv.similarity("kichta", "moula")
0.57091457

model.wv.similarity("bonheur", "moula")
0.09769239

1. Or even get the vector representation of a word

model.wv['ekip']
array([ 1.4757039e-01,  ... 1.1260221e+00],
      dtype=float32)

Purpose and Disclaimer

This model is designed for academic and research purposes only. It is not intended for commercial use. The creators of this model do not endorse or promote any specific views or opinions that may be represented in the dataset.

Please mention @RapMinerz if you use our models

Contact

For any questions or issues, please contact the repository owner, RapMinerz, at [email protected].