pub fn topical_terms(text: &str) -> Vec<String>Expand description
The topical terms of an utterance or query.
What survives after function words, the vocabulary of asking, and the corpus’s own subject form are removed. Short tokens go too: at two characters a token is almost always a fragment of a contraction.
Shared by the planner and by the synchronous tool path so the two cannot drift into disagreeing about what a query is made of.