Setting this flag to true means that there are currently no more
buffers available so that analyzer should return all the tokens
including those whose successful scanning would be otherwise
left for later when the next buffer will be available.
Initialize the analyzer when scanning from the begining
of the document or when the state stored in syntax mark
is null for some reason or to explicitly reset the analyzer
to the initial state.
Deprecated.this class is deprecated as the number of bundle queries is proportional
to the number of registered localizers which is not optimal from the performance
point of view. The queries through this class should be replaced
by queries to individual bundles.