Parser implementation #139
Merged
Commits on Aug 25, 2023
-
-
This is a port of Farkle 6's `StackNeo`.
-
-
-
-
-
-
-
Commits on Aug 27, 2023
-
-
Do not discard the last token of a non-final block if the DFA cannot …
…proceed from its current state.
-
-
Commits on Aug 29, 2023
-
Track in ParserState if suspending the tokenizer is supported.
I thought that suspending the tokenizer without being in a chain would have no effect, but it actually has the effect of prohibiting subsequent suspensions. With this change, suspending is a real no-op if the tokenizer is not wrapped in a chain.
-
-
Fix a bug in
CharacterBufferManager.`GetWriteBufferOffset` can resize the buffer, but calls to `_buffer.AsSpan(GetWriteBufferOffset(sizeHint))` always use the old buffer. The code was restructured to make the correct way to do it more apparent.
-
Push the initial state to the LR parser stack.
Turns out it is always needed to do GOTOs from the initial state if we reduce a production with as many members as the stack. And with that we don't need to separately track the LR state anymore; it's at the top of the stack.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.