Code

Lexer tweaks#133070

Code

Merged

bors merged 6 commits intorust-lang:masterrust-lang/rust:masterfrom

nnethercote:lexer-tweaksnnethercote/rust:lexer-tweaksCopy head branch name to clipboard

Nov 27, 2024

Commits

Commits on Nov 25, 2024

• Merge `TokenTreesReader` into `StringReader`.

  Show description for 98777b4
  nnethercote

  committed
  98777b4

  Copy full SHA for 98777b4

• Split `Lexer::bump`.

  Show description for 593cf68
  nnethercote

  committed
  593cf68

  Copy full SHA for 593cf68

• Fix some formatting.

  Show description for ba1a1dd
  nnethercote

  committed
  ba1a1dd

  Copy full SHA for ba1a1dd

• Improve `strip_shebang` testing.

  Show description for 11c96cf
  nnethercote

  committed
  11c96cf

  Copy full SHA for 11c96cf

• Clean up `c_or_byte_string`.

  Show description for 4cd2840
  nnethercote

  committed
  4cd2840

  Copy full SHA for 4cd2840

• Streamline `lex_token_trees` error handling.

  Show description for 16a39bb
  nnethercote

  committed
  16a39bb

  Copy full SHA for 16a39bb