genres-distill

Model description:

This is a simple model aimed at predicting the genres of an arbitrary Web text.

It should be integrateable into the standard pipelines. For example:

from transformers import pipeline
classifier = pipeline("text-classification",model='ssharoff/genres-distill')
print(classifier("Alice was beginning to get very tired of sitting by her sister on the bank, and of having nothing to do: once or twice she had peeped into the book her sister was reading, but it had no pictures or conversations in it. `And what is the use of a book,' thought Alice `without pictures or conversation? So she was considering in her own mind (as well as she could, for the hot day made her feel very sleepy and stupid), whether the pleasure of making a daisy-chain would be worth the trouble of getting up and picking the daisies, when suddenly a White Rabbit with pink eyes ran close by her. There was nothing so very remarkable in that; nor did Alice think it so very much out of the way to hear the Rabbit say to itself, `Oh dear! Oh dear! I shall be late!' (when she thought it over afterwards, it occurred to her that she ought to have wondered at this, but at the time it all seemed quite natural); but when the Rabbit actually took a watch out of its waistcoat-pocket, and looked at it, and then hurried on, Alice started to her feet, for it flashed across her mind that she had never before seen a rabbit with either a waistcoat-pocket, or a watch to take out of it, and burning with curiosity, she ran across the field after it, and fortunately was just in time to see it pop down a large rabbit-hole under the hedge. In another moment down went Alice after it, never once considering how in the world she was to get out again. The rabbit-hole went straight on like a tunnel for some way, and then dipped suddenly down, so suddenly that Alice had not a moment to think about stopping herself before she found herself falling down a very deep well.", top_k=2))
print(classifier("The gratitude of every home in our Island, in our Empire, and indeed throughout the world, except in the abodes of the guilty, goes out to the British airmen who, undaunted by odds, unwearied in their constant challenge and mortal danger, are turning the tide of the World War by their prowess and by their devotion. Never in the field of human conflict was so much owed by so many to so few. ", top_k=2))

The system of categories for predictions follows:

@Article{sharoff18genres,
  author =       {Serge Sharoff},
  title =        {Functional Text Dimensions for the annotation of {Web} corpora},
  journal =      {Corpora},
  volume =       {13},
  number =       {1},
  pages =        {65--95},
  year =         {2018}
}

[http://corpus.leeds.ac.uk/serge/publications/2018-ftd.pdf]