org.apache.lucene.analysis

Class TokenStream

Known Direct Subclasses:
TokenFilter, Tokenizer

public abstract class TokenStream
extends Object

A TokenStream enumerates the sequence of tokens, either from fields of a document or from query text.

This is an abstract class. Concrete subclasses are:

Method Summary

void
close()
Releases resources associated with this stream.
abstract Token
next()
Returns the next token in the stream, or null at EOS.

Method Details

close

public void close()
            throws IOException
Releases resources associated with this stream.

next

public abstract Token next()
            throws IOException
Returns the next token in the stream, or null at EOS.

Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.