I am using boost 1.31 Tokenizer. The question I have is Can boost tokenizer
change the predicates on the fly?
For example:
string s = "my birthday is 1976, 15/17";
boost::tokenizer<> tok(s);
boost::tokenizer<>::iterator beg=tok.begin();
// here *beg will give us "my"
typedef boost::tokenizer
Boost_char_tokenizer;
boost::char_separator<char> sep(",/");
Boost_char_tokenizer next(s, sep);
Boost_char_tokenizer::iterator tok_iter = next.begin();
for(; tok_iter!=next.end(); ++tok_iter){
std::cout << *tok_iter << std::endl;
}
// this will give us "my birthday is 1976", "15" and "17"
But what I want to get is "my", "birthday is 1976", "15" and "17".
In other words, I want the tokenizer either can give us the remaining of the
string or can change the delimiters dynamically.
Is there a way to do this?
Thanks for any help.
