Extracted from Pike v7.8 release 866 at 2016-11-06.
pike.ida.liu.se
[Top]
Search
Search.Utils

Method Search.Utils.tokenize_and_normalize()


Method tokenize_and_normalize

array(string) tokenize_and_normalize(string what)

Description

This can be optimized quite significantly when compared to tokenize( normalize( x ) ) in the future, currently it's not all that much faster, but still faster.