Package: kgrams 0.2.0

kgrams: Classical k-gram Language Models

Training and evaluating k-gram language models in R, supporting several probability smoothing techniques, perplexity computations, random text generation and more.

Authors:Valerio Gherardi [aut, cre]

kgrams_0.2.0.tar.gz
kgrams_0.2.0.zip(r-4.5)kgrams_0.2.0.zip(r-4.4)kgrams_0.2.0.zip(r-4.3)
kgrams_0.2.0.tgz(r-4.4-arm64)kgrams_0.2.0.tgz(r-4.4-x86_64)kgrams_0.2.0.tgz(r-4.3-arm64)kgrams_0.2.0.tgz(r-4.3-x86_64)
kgrams_0.2.0.tar.gz(r-4.5-noble)kgrams_0.2.0.tar.gz(r-4.4-noble)
kgrams_0.2.0.tgz(r-4.4-emscripten)kgrams_0.2.0.tgz(r-4.3-emscripten)
kgrams.pdf |kgrams.html✨
kgrams/json (API)
NEWS

# Install 'kgrams' in R:

install.packages('kgrams', repos = c('https://vgherard.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/vgherard/kgrams/issues

Uses libs:

c++– GNU Standard C++ Library v3

Datasets:

midsummer - A Midsummer Night's Dream
much_ado - Much Ado About Nothing

On CRAN:

language-models n-grams natural-language-processing

21 exports 7 stars 1.33 score 5 dependencies 220 downloads

Last updated 10 months agofrom:7d7e59dc60 (on v0.2.0)

Exports:%+%%|%as_dictionary BOS dictionary EOS info kgram_freqs language_model param param<-parameters perplexity preprocess probability process_sentences query sample_sentences smoothers tknz_sent UNK

Dependencies:rbibutils Rcpp RcppProgress Rdpack rlang

Classical $k$-gram Language Models in R

Valerio Gherardi

Rendered fromkgrams.Rmdusingknitr::rmarkdownon Jul 10 2024.

Last update: 2023-10-06
Started: 2021-02-06

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
String concatenation	%+%
Word dictionaries	as.character.kgrams_dictionary as_dictionary as_dictionary.character as_dictionary.kgrams_dictionary dictionary dictionary.character dictionary.connection dictionary.kgram_freqs
Special Tokens	BOS EOS special_tokens UNK
k-gram Frequency Tables	kgram_freqs kgram_freqs.character kgram_freqs.connection kgram_freqs.kgram_freqs kgram_freqs.numeric process_sentences process_sentences.character process_sentences.connection
k-gram Language Models	language_model language_model.kgram_freqs language_model.language_model
A Midsummer Night's Dream	midsummer
Much Ado About Nothing	much_ado
Language Model Parameters	param param.kgram_freqs param<- parameters
Language Model Perplexities	perplexity perplexity.character perplexity.connection
Text preprocessing	preprocess
Language Model Probabilities	probability probability.character probability.kgrams_word_context
Query k-gram frequency tables or dictionaries	query query.kgrams_dictionary query.kgram_freqs
Random Text Generation	sample_sentences
k-gram Probability Smoothers	info smoothers
Sentence tokenizer	tknz_sent
Word-context conditional expression	%\|% word_context