[Python-Dev] Lexical analysis and NEWLINE tokens (original) (raw)
Phillip J. Eby pje at telecommunity.com
Thu Oct 6 18:11:17 CEST 2005
- Previous message: [Python-Dev] Lexical analysis and NEWLINE tokens
- Next message: [Python-Dev] Static builds on Windows (continued)
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
At 07:36 AM 10/6/2005 -0500, Matthew F. Barnes wrote:
I posted this question to python-help, but I think I have a better chance of getting the answer here.
I'm looking for clarification on when NEWLINE tokens are generated during lexical analysis of Python source code.
If you're talking about the "tokenize" module, NEWLINE is only generated following a logical line, which is one that contains code.
- Previous message: [Python-Dev] Lexical analysis and NEWLINE tokens
- Next message: [Python-Dev] Static builds on Windows (continued)
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]