JOSS Papers: Tokenization

All Papers
3987
 Published Papers
3459
 Active Papers
528
published Published 19 days ago

KeemenaPreprocessing.jl: Unicode-Robust Cleaning, Multi-Level Tokenisation and Streaming Offset Bundling for Julia NLP

Julia
@mantzaris
10.21105/joss.09348
published Published over 5 years ago

Talisman: a JavaScript archive of fuzzy matching, information retrieval and record linkage building blocks

JavaScript
@Yomguithereal
10.21105/joss.02405
published Published about 6 years ago

WordTokenizers.jl: Basic tools for tokenizing natural language in Julia

Julia
@oxinabox
10.21105/joss.01956
published Published almost 8 years ago

Fast, Consistent Tokenization of Natural Language Text

R C++
@lmullen
10.21105/joss.00655
Displaying 4 papers

Journal of Open Source Software is an affiliate of the Open Source Initiative.

Journal of Open Source Software is part of Open Journals, which is a NumFOCUS-sponsored project.

Table of Contents
Public user content licensed CC BY 4.0 unless otherwise specified.
ISSN 2475-9066