edu.stanford.nlp.process
Class PTBTokenizer

java.lang.Object
  |
  +--edu.stanford.nlp.process.AbstractTokenizer
        |
        +--edu.stanford.nlp.process.PTBTokenizer

All Implemented Interfaces:

Tokenizer

public class PTBTokenizer

extends AbstractTokenizer

Constructor Summary

PTBTokenizer()

Method Summary

static void	main(String[] args)
Collection	tokenize(Reader textReader) Returns text as a Collection of Words

Methods inherited from class edu.stanford.nlp.process.AbstractTokenizer

tokenize, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PTBTokenizer

public PTBTokenizer()

Method Detail

tokenize

public Collection tokenize(Reader textReader)

Description copied from class: AbstractTokenizer

Returns text as a Collection of Words

Specified by:

tokenize in interface Tokenizer

Specified by:

tokenize in class AbstractTokenizer

main

public static void main(String[] args)
                 throws Exception

Exception