Xale::Query::BasicTokenizer Class Reference

Basic implementation of SQL tokenizer. More...

#include <BasicTokenizer.h>

Inheritance diagram for Xale::Query::BasicTokenizer:

Collaboration diagram for Xale::Query::BasicTokenizer:

Public Member Functions
void	setInput (const std::string &input) override
	Set the input string to tokenize.
Token	nextToken () override
	Get the next token.
Token	peekToken () const override
	Get the current token.
void	reset () override
	Reset the cursor and the current token.
std::vector< Token >	tokenize () override
	Tokenize all the input.

Detailed Description

Basic implementation of SQL tokenizer.

Member Function Documentation

nextToken()

Token Xale::Query::BasicTokenizer::nextToken ( )

overridevirtual

Get the next token.

Implements Xale::Query::ITokenizer.

peekToken()

Token Xale::Query::BasicTokenizer::peekToken ( ) const

overridevirtual

Get the current token.

Implements Xale::Query::ITokenizer.

reset()

void Xale::Query::BasicTokenizer::reset ( )

overridevirtual

Reset the cursor and the current token.

Implements Xale::Query::ITokenizer.

setInput()

void Xale::Query::BasicTokenizer::setInput ( const std::string & input )

overridevirtual

Set the input string to tokenize.

Implements Xale::Query::ITokenizer.

tokenize()

std::vector< Token > Xale::Query::BasicTokenizer::tokenize ( )

overridevirtual

Tokenize all the input.

Implements Xale::Query::ITokenizer.

---

The documentation for this class was generated from the following files:

• include/Query/BasicTokenizer.h
• src/Query/BasicTokenizer.cpp