Boost C++ Libraries: Ticket #2774: boost::tokenize fails on Ubuntu8.10 64bit

attachment set

grumbel@… — Tue, 17 Feb 2009 23:02:25 GMT

attachment → token.cpp

Tokenizer Example

status changed; resolution set

Steven Watanabe — Wed, 18 Feb 2009 01:26:47 GMT

status new → closed
resolution → invalid

tokenizer does not store a copy of the string, it stores a pair of iterators. The temporary string that you are passing to the constructor is immediately destroyed, invalidating the iterators.

This works:

      std::string arg(argv[1]);
      tokenizer tokens(arg, sep);

william.l.blevins@… — Thu, 07 Jun 2012 18:40:58 GMT

How is this ticket invalid?

BoostTokenizer provides a constructor that allows for:

memory corruption
tokens are arbitrarily parsed incorrectly

// This should be valid
tokenizer tokens(std::string(argv[1]), sep);

There should at least be documentation for a precondition {@precondition} where this case is listed explicitly.