[boost] Re: [tokenizer and token_iterator]requestforpolicyorredesign

| Token iterator construction based on two iterators IMO is useful only for | istream tokenization. I do provide this interface but as stand alone class.

I think I disagree. Consider the match of some regular expression applied to a each line in a file. If you then want to tokenize each macth, then you don't want copy strings around but work on a view.

br

Thorsten

Yeah. You right. I should've said "mostly useful". There some (comparatively rare) case when you want to utilize iterator interface. But it does not change my point: it still does not justify polluting main line interface. Gennadiy.