Line number with comments and propagate_positions, lalr

When propagate_positions=True, the result tree contains line and column number. However, they count only ‘actual statements’, ignoring things like comments and blank lines specified via %ignore.

I would like to pinpoint the location to the end user, for this to happen I need the line number to include those ignored statements, not just the actual ones.

With ‘lalr’ parser, is this possible in the current implementation?

[erezsh]

If I understand you correctly, you want a way to access the ignored tokens?

That is possible using lexer_callbacks. Here’s an example of it in use: https://github.com/geographika/mappyfile/blob/master/mappyfile/parser.py#L31

The ignored tokens will have the correct line and column. Matching these tokens to the correct spot in the tree is possible, but isn’t a trivial effort.

[erezsh]

Add docs under https://lark-parser.readthedocs.io/en/latest/recipes/