bpo-33899: Mention tokenize behavior change in What's New (GH-10073) · python/cpython@dfba1f6 (original) (raw)

Original file line number	Diff line number	Diff line change
@@ -2414,3 +2414,11 @@ Notable changes in Python 3.6.5
2414	2414	The :func:`locale.localeconv` function now sets temporarily the ``LC_CTYPE``
2415	2415	locale to the ``LC_NUMERIC`` locale in some cases.
2416	2416	(Contributed by Victor Stinner in :issue:`31900`.)
	2417	+
	2418	+Notable changes in Python 3.6.7
	2419	+===============================
	2420	+
	2421	+In 3.6.7 the :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token
	2422	+when provided with input that does not have a trailing new line. This behavior
	2423	+now matches what the C tokenizer does internally.
	2424	+(Contributed by Ammar Askar in :issue:`33899`.)