Method Parser._parser._C.tokenize()
- Method tokenize
array(array(string)|string) tokenize(stringcode)- Description
Tokenize a string of C tokens.
- Note
Don't use this function directly. Use Parser.C.tokenize() instead.
- Returns
Returns an array with an array with C-level tokens, and the remainder (a partial token), if any.