Skip to content

Commit 2a58b06

Browse files
asottilemiss-islington
authored andcommitted
bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)
https://bugs.python.org/issue5028
1 parent eea47e0 commit 2a58b06

File tree

3 files changed

+4
-4
lines changed

3 files changed

+4
-4
lines changed

Doc/library/tokenize.rst

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -39,8 +39,8 @@ The primary entry point is a :term:`generator`:
3939
column where the token begins in the source; a 2-tuple ``(erow, ecol)`` of
4040
ints specifying the row and column where the token ends in the source; and
4141
the line on which the token was found. The line passed (the last tuple item)
42-
is the *physical* line; continuation lines are included. The 5 tuple is
43-
returned as a :term:`named tuple` with the field names:
42+
is the *physical* line. The 5 tuple is returned as a :term:`named tuple`
43+
with the field names:
4444
``type string start end line``.
4545

4646
The returned :term:`named tuple` has an additional property named

Lib/lib2to3/pgen2/tokenize.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -346,7 +346,7 @@ def generate_tokens(readline):
346346
column where the token begins in the source; a 2-tuple (erow, ecol) of
347347
ints specifying the row and column where the token ends in the source;
348348
and the line on which the token was found. The line passed is the
349-
physical line; continuation lines are included.
349+
physical line.
350350
"""
351351
lnum = parenlev = continued = 0
352352
contstr, needcont = '', 0

Lib/tokenize.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -415,7 +415,7 @@ def tokenize(readline):
415415
column where the token begins in the source; a 2-tuple (erow, ecol) of
416416
ints specifying the row and column where the token ends in the source;
417417
and the line on which the token was found. The line passed is the
418-
physical line; continuation lines are included.
418+
physical line.
419419
420420
The first token sequence will always be an ENCODING token
421421
which tells you which encoding was used to decode the bytes stream.

0 commit comments

Comments
 (0)