https://svn.boost.org/trac10/ticket/6024 <p> Hi, </p> <blockquote class="citation"> <p> explicit char_separator() </p> </blockquote> <p> Explicit? Doesn't explicit only apply to one argument constructors? </p> <blockquote class="citation"> <p> The function std::isspace() is used to identify dropped delimiters and std::ispunct() is used to identify kept delimiters. In addition, empty tokens are dropped. </p> </blockquote> <blockquote> <p> std::string s("<a class="changeset" href="https://svn.boost.org/trac10/changeset/1" title="Import core sources for SVNmanger 0.38 ">[1]</a><a class="changeset" href="https://svn.boost.org/trac10/changeset/3" title="Tweak disclaimer text">[3]</a><a class="changeset" href="https://svn.boost.org/trac10/changeset/5" title="Boost customization">[5]</a>[]9"); BOOST_FOREACH(auto i, boost::tokenizer&lt;&gt;(s)) </p> <blockquote> <p> std::cout &lt;&lt; i &lt;&lt; std::endl; </p> </blockquote> </blockquote> <p> This outputs only numbers. Shouldn't the brackets be included too? </p> en-us /htdocs/site/boost.png https://svn.boost.org/trac10/ticket/6024 Trac 1.4.3