Package opennlp.tools.languagemodel

Interface LanguageModel

  • All Known Implementing Classes:
    NGramLanguageModel
    public interface LanguageModel
    A language model can calculate the probability p (between 0 and 1) of a certain sequence of tokens, given its underlying vocabulary.

    • Method Detail

      • calculateProbability

        @Deprecated
double calculateProbability​(StringList tokens)
        Deprecated.
        use calculateProbability(String...)
        Calculate the probability of a series of tokens (e.g. a sentence), given a vocabulary.
        Parameters:
        tokens - the text tokens to calculate the probability for
        Returns:
        the probability of the given text tokens in the vocabulary

      • calculateProbability

        double calculateProbability​(String... tokens)
        Calculate the probability of a series of tokens (e.g. a sentence), given a vocabulary.
        Parameters:
        tokens - the text tokens to calculate the probability for
        Returns:
        the probability of the given text tokens in the vocabulary

      • predictNextTokens

        @Deprecated
StringList predictNextTokens​(StringList tokens)
        Deprecated.
        use predictNextTokens(String...)
        Predict the most probable output sequence of tokens, given an input sequence of tokens.
        Parameters:
        tokens - a sequence of tokens
        Returns:
        the most probable subsequent token sequence

      • predictNextTokens

        String[] predictNextTokens​(String... tokens)
        Predict the most probable output sequence of tokens, given an input sequence of tokens.
        Parameters:
        tokens - a sequence of tokens
        Returns:
        the most probable subsequent token sequence