Extracted from Pike v7.8 release 866 at 2016-11-06.
pike.ida.liu.se
[Top]
Parser
Parser.C

Classes
 Token

Methods
 group()
 hide_whitespaces()
 reconstitute_with_line_numbers()
 simple_reconstitute()
 split()
 strip_line_statements()
 tokenize()
previousParser.C.strip_line_statements()
Parser.LRnext

Method Parser.C.tokenize()

Method tokenize

array(Token) tokenize(array(string) s, void|string file)

Description

Returns an array of Token objects given an array of string tokens.