lex::lexertl::generate_static_dfa compiler errors if lexer has wchar_t as underlying stream type

[Ryan Molden <ryanmolden@…>]

Try and compile the following code, you will get compiler errors because generate_static.hpp has one line which says a std::map has a element type of char when, in this case, it should be wchar_t. After fixing that to use Char (which is an existing template param on the method with the error) the output C++ code from this method further encodes 'char' in a number of places thus compiling a lexer using the produced static table also fails.

<--------------------- Begin Repro ------------------------------>

#include <fstream> #include <boost/config/warning_disable.hpp> #include <boost/spirit/include/lex_lexertl.hpp> #include <boost/spirit/include/lex_generate_static_lexertl.hpp> #include <boost/spirit/include/lex_static_lexertl.hpp>

using namespace std; using namespace boost::spirit;

template <typename BaseLexer> struct MyLexer : boost::spirit::lex::lexer<BaseLexer> {

MyLexer() {

token = L"Yay winning!"; this->self = token;

}

lex::token_def<lex::unused_type, wchar_t> token;

};

int main(int argc, char* argv[]) {

typedef lex::lexertl::token<const wchar_t*> token_type; typedef lex::lexertl::lexer<token_type> lexer_type;

MyLexer<lexer_type> lexer;

ofstream outputStream("test.hpp");

return lex::lexertl::generate_static_dfa(lexer, outputStream, "test") ? 0 : -1;

}

[Ryan Molden <ryanmolden@…>]

This is a hacky fix I have used locally to unblock myself. Don't think it is boost quality or even necessarily the right approach, including mostly for completeness.

[Ryan Molden <ryanmolden@…>]

hmmm the tracking system apparently did some weird formatting on my repro including eliminating new lines and adding ? after some things...not sure why. Sorry about that.

[Hartmut Kaiser]

Replying to Ryan Molden <ryanmolden@…>:

hmmm the tracking system apparently did some weird formatting on my repro including eliminating new lines and adding ? after some things...not sure why. Sorry about that.

Would you mind (re-)attaching your code snippet to this ticket?

Regards Hartmut

[Ryan Molden <ryanmolden@…>]

Repro of bug as attachment (the ticket system did some weird formatting to it for unknown reasons)

[Ryan Molden <ryanmolden@…>]

Sure thing, added as attachment, looks better when viewed that way.

[Hartmut Kaiser]

(In [75910]) Spirit: fixed #6253: lex::lexertl::generate_static_dfa compiler errors if lexer has wchar_t as underlying stream type

[Ryan Molden <ryanmolden@…>]

Wow, thanks for the quick fix!