Method Search.Utils.tokenize_and_normalize()

Method tokenize_and_normalize

array(string) tokenize_and_normalize(string what)

Description

This can be optimized quite significantly when compared to tokenize( normalize( x ) ) in the future, currently it's not all that much faster, but still faster.