Re: lexer.ll: Warn about non-UTF-8 characters (issue 5505090)

[dak]

On 2012/01/01 10:05:42, Keith wrote:
> On Sun, 01 Jan 2012 01:40:36 -0800, <mailto:address@hidden> wrote:

> > Our lexer has been written with the decision of using non-compressed
> > tables and without backing up.

> Off topic, but maybe interesting to you: I don't think that decision
was ever
> implemented.

I do.

> I don't see any "%option full" or similar that would generate
> non-compressed tables.

stepmake/stepmake/c++-rules.make:       $(FLEX) -Cfe -p -p -o$@ $<

Look up -Cfe

> Consider a comment in your case/switch statement that points to some
reference on the various types of UTF-8 validators.

I don't understand.

http://codereview.appspot.com/5505090/