LiveNew tools this week

Xerv-AI

CRAYON-tokenizer

Tags

tokenizers
hardware-accelerated
avx2
cuda
rocm
double-array-trie
crayon
en
license:mit
region:us

Languages

en

Author: Xerv-AI
Task: text-generation
Library: generic
License: mit
Downloads: 0
Likes: 2

CRAYON-tokenizer — AI Model — AIMarketly