[boost] Re: [tokenizer and token_iterator] request forpolicyorredesign

| This is result of my redesign on boost::token_iterator. My version supposed | to be efficient (comparatevely) | | Let me know what you think.

I guess you basic_cstring<> has a large say in why it would be faster?

You guess right. Gennadiy.