[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
common per-token info
From: |
John W. Millaway |
Subject: |
common per-token info |
Date: |
Mon, 7 Jan 2002 11:08:39 -0800 (PST) |
Akim: Just for the sake of example, can you give us a scenario for which you
need to track the "width" of each token, (where width != yyleng) ?
Everyone: What are some example parsers/grammars that need per-token
information not covered by the list [file,line,column, USER_DEFINED_MEMBERS].
Let's assume that we can implement optional file, line, and column tracking
mechansims that are reasonably configurable (zero-based or one-based, handles
"\r\n", etc.), and that do not tarnish the holy grail of DFA speed. What will
we miss? Is this too much information per-token? Do most parsers unwrap tokens,
then rewrap them in user-defined objects at the parser level anyway (discarding
the information gathered by the scanner)?
What I'm looking to define is a practical common base of per-token information
that is expected by the various grammars and parser generators out there.
__________________________________________________
Do You Yahoo!?
Send FREE video emails in Yahoo! Mail!
http://promo.yahoo.com/videomail/
- Re: why are locations dictated by bison?, (continued)
- Re: why are locations dictated by bison?, Hans Aberg, 2002/01/15
- Re: why are locations dictated by bison?, Hans Aberg, 2002/01/15
- Re: why are locations dictated by bison?, Bruce Lilly, 2002/01/16
- Re: why are locations dictated by bison?, Hans Aberg, 2002/01/16
- Re: why are locations dictated by bison?, Bruce Lilly, 2002/01/16
- Re: why are locations dictated by bison?, Hans Aberg, 2002/01/17
- Re: why are locations dictated by bison?, Bruce Lilly, 2002/01/17
- Re: why are locations dictated by bison?, Hans Aberg, 2002/01/18
- Re: why are locations dictated by bison?, Bruce Lilly, 2002/01/18
- Re: why are locations dictated by bison?, Hans Aberg, 2002/01/18
- common per-token info,
John W. Millaway <=
- Re: common per-token info, Hans Aberg, 2002/01/07
- Re: common per-token info, Hans Aberg, 2002/01/09
- Re: common per-token info, Akim Demaille, 2002/01/09
- Re: common per-token info, Hans Aberg, 2002/01/09
- Re: Locations suggest -- we're stupid, Nikos Balkanas, 2002/01/07
- Re: Locations suggest -- we're stupid, Hans Aberg, 2002/01/08
- Re: Locations suggest -- we're stupid, Nikos Balkanas, 2002/01/08
- Re: Locations suggest -- we're stupid, Hans Aberg, 2002/01/09
- Re: Locations suggest -- we're stupid, Nikos Balkanas, 2002/01/10
- Re: Locations suggest -- we're stupid, Hans Aberg, 2002/01/11