Module jEdit

Package org.gjt.sp.jedit.syntax

Class DefaultTokenHandler

java.lang.Object

org.gjt.sp.jedit.syntax.DefaultTokenHandler

All Implemented Interfaces:

TokenHandler

Direct Known Subclasses:

DisplayTokenHandler

public class DefaultTokenHandler
extends Object
implements TokenHandler

Builds a linked list of tokens without any additional processing.

Since:

jEdit 4.1pre1

Version:

$Id: DefaultTokenHandler.java 25244 2020-04-15 15:14:49Z kpouer $

Author:

Slava Pestov

Field Summary

Fields

Modifier and Type	Field	Description
protected Token	firstToken
protected Token	lastToken
protected TokenMarker.LineContext	lineContext

Constructor Summary

Constructors

Constructor	Description
DefaultTokenHandler()

Method Summary

Modifier and Type	Method	Description
protected void	addToken(Token token, TokenMarker.LineContext context)
protected Token	createToken(byte id, int offset, int length, TokenMarker.LineContext context)
TokenMarker.LineContext	getLineContext()	The token handler can compare this object with the object previously given for this line to see if the token type at the end of the line has changed (meaning subsequent lines might need to be retokenized).
protected ParserRuleSet	getParserRuleSet(TokenMarker.LineContext context)
Token	getTokens()	Returns the first syntax token.
void	handleToken(Segment seg, byte id, int offset, int length, TokenMarker.LineContext context)	Called by the token marker when a syntax token has been parsed.
void	init()	Clears the list of tokens.
void	setLineContext(TokenMarker.LineContext lineContext)	The token handler can compare this object with the object previously given for this line to see if the token type at the end of the line has changed (meaning subsequent lines might need to be retokenized).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

firstToken

protected Token firstToken

lastToken

protected Token lastToken

lineContext

protected TokenMarker.LineContext lineContext

Constructor Details

DefaultTokenHandler

public DefaultTokenHandler()

Method Details

init

public void init()

Clears the list of tokens.

getTokens

public Token getTokens()

Returns the first syntax token.

Since:

jEdit 4.1pre1

handleToken

public void handleToken(Segment seg,
 byte id,
 int offset,
 int length,
 TokenMarker.LineContext context)

Called by the token marker when a syntax token has been parsed.

Specified by:

handleToken in interface TokenHandler

Parameters:

seg - The segment containing the text

id - The token type (one of the constants in the Token class).

offset - The start offset of the token

length - The number of characters in the token

context - The line context

Since:

jEdit 4.2pre3

getLineContext

public TokenMarker.LineContext getLineContext()

The token handler can compare this object with the object previously given for this line to see if the token type at the end of the line has changed (meaning subsequent lines might need to be retokenized).

Since:

jEdit 4.2pre6

setLineContext

public void setLineContext(TokenMarker.LineContext lineContext)

The token handler can compare this object with the object previously given for this line to see if the token type at the end of the line has changed (meaning subsequent lines might need to be retokenized).

Specified by:

setLineContext in interface TokenHandler

Since:

jEdit 4.2pre6

getParserRuleSet

protected ParserRuleSet getParserRuleSet(TokenMarker.LineContext context)

createToken

protected Token createToken(byte id,
 int offset,
 int length,
 TokenMarker.LineContext context)

addToken

protected void addToken(Token token,
 TokenMarker.LineContext context)