Tokenizer.hpp doesn't work with BOOST_ENABLE_ASSERT_HANDLER

[nobody]

Using boost-1.31.0

Tokenizer.hpp has  #include <cassert> on line 23 - this 
prevents a custom assert function from working 
properly when trying to use 
BOOST_ENABLE_ASSERT_HANDLER.

It looks like token_iterator.hpp and 
token_functions.hpp also do the same thing.

It would be nice if these used the common boost assert 
mechanism instead of directly #including <cassert>.

[Markus Schöpflin]

Logged In: YES 
user_id=91733

This seems like a reasonable request. Now in CVS.