edu.stanford.nlp.ie.desc
Class ChunkerTokenManager
java.lang.Object
|
+--edu.stanford.nlp.ie.desc.ChunkerTokenManager
- All Implemented Interfaces:
- ChunkerConstants
- public class ChunkerTokenManager
- extends Object
- implements ChunkerConstants
Fields inherited from interface edu.stanford.nlp.ie.desc.ChunkerConstants |
ADJ, ADJNP, ADVERB, ALPHANUM, ANY, CLOSE, COMMA, COORD_CONJ, DEFAULT, DET, EOF, IAM, IHAVEBEEN, ILLBE, IM, IWAS, IWILLBE, NOUN, NP, NP1, NUMBER, OPEN, OTHER, PREP, PRONOUN, PUNCT, SLASH, TAGGED_COMMA, tokenImage, VERB, WHITESPACE, WORD |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
debugStream
public PrintStream debugStream
jjstrLiteralImages
public static final String[] jjstrLiteralImages
lexStateNames
public static final String[] lexStateNames
curChar
protected char curChar
ChunkerTokenManager
public ChunkerTokenManager(SimpleCharStream stream)
ChunkerTokenManager
public ChunkerTokenManager(SimpleCharStream stream,
int lexState)
setDebugStream
public void setDebugStream(PrintStream ds)
ReInit
public void ReInit(SimpleCharStream stream)
ReInit
public void ReInit(SimpleCharStream stream,
int lexState)
SwitchTo
public void SwitchTo(int lexState)
getNextToken
public final Token getNextToken()
Stanford NLP Group