Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Process all non-ASCII bytes with the UTF-8 parser. #58

Closed
wants to merge 1 commit into from
Closed

Process all non-ASCII bytes with the UTF-8 parser. #58

wants to merge 1 commit into from

Commits on Jun 15, 2020

  1. Process all non-ASCII bytes with the UTF-8 parser. 

    The UTF-8 parser knows how to handle invalid byte sequences, so don't
preprocess the input in the main parser; just hand any non-ASCII byte to
the UTF-8 parser to handle.

This includes what were previously interpreted as 8-bit C1 control codes;
they are now interpreted as UTF-8 continuation characters.
    @sunfishcode
    sunfishcode committed Jun 15, 2020
    Configuration menu
    Copy the full SHA
    f75b04c View commit details
    Browse the repository at this point in the history