Language Modeling

From Clarin K-Centre
Jump to navigation Jump to search

n-gram modeling[edit]

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool colibri-patternmodeller which allows you to build, view, manipulate and query pattern models.

BERT-like models[edit]

SpaCy[edit]