Albert Weichselbraun

is a Professor of Information Science at the University of Applied of the Grisons.

Extracting Concepts

less than 1 minute read

This article collects some thoughts on normalizing phrases to concepts.

Examples:

  • drive_car <- "drive a car", "you drive your car", "driving cars" and "drive there in a car",
  • buy_christmas_present <- "I bought a lot of very nice Christmas presents", "let buy christmas presents", ...
Method:

  1. POS Tagging -> remove all POS tags not in ('nouns', 'verbs')
  2. lemmatization
  3. combine words with a "_" :-)

You may also enjoy

Suffix array

1 minute read

The suffix array is a memory-efficient alternative to the suffix tree which provides a sorted list of string indices indicating the string’s suffixes.