Newline character as list delimiter?

Cant figure out how to parse a line by line file (CSV, or other list…)

from pyleri import Choice, Grammar, Keyword, List, Optional, Ref, Regex, Sequence, Token
import os


class MyGrammar(Grammar):
	element = Regex(r"\w+")
	START = List(element, "\n", opt=True)


grammar = MyGrammar()
result = grammar.parse("word\nword\n").as_str()

print(result)

error at position 5, expecting:

Tried with combination of \n, \n, os.linesep…

No luck

Any idea?

[joente]

Maybe your use-case can be solved with Repeat instead of a List:

from pyleri import Repeat, Grammar, Regex

class MyGrammar(Grammar):
	element = Regex(r"\w+")
	START = Repeat(element)

grammar = MyGrammar()
print(grammar.parse("word\nword\n").as_str())  # parsed successfully

However, if it get’s more complicated you might run into to problems since pyleri handles all white-space (including line breaks) equally. This could be solved rather easy though, for example we could allow a user to define the white-space used in a grammar by RE_WHITESPACE, like we do with RE_KEYWORDS.

[joente]

@wqp89324, pyleri is currently using strip without any arguments for handling white-space between nodes.