[Python-Dev] tokenize string literal problem (original) (raw)
C or L Smith smiles at worksmail.net
Sat Oct 24 08:33:10 CEST 2009
- Previous message: [Python-Dev] tokenize string literal problem
- Next message: [Python-Dev] Clean up Python/thread_*.h ?
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
C or L Smith wrote:
PROBLEM I need to find code snippets which are located in docstrings. Docstrings, being string literals should be able to be parsed out with tokenize. But tokenize is giving the wrong results (or I am doing something wrong) for this (pathological) case:
foo.py: +---- def bar(): """ A quoted triple quote is not a closing of this docstring: >>> print '"""' """ """ # <-- this is the closing quote pass +----
I now see that I've created a code snippet that is invalid. Myopia. The thing that pythonWin was doing correctly was displaying my sample STRING not code. I had delimited the code with triple-single-quotes so it showed up correctly. In fact, if entered as code it would show the need to delimit the docstring contents with ''' rather than """.
Sorry! /c
- Previous message: [Python-Dev] tokenize string literal problem
- Next message: [Python-Dev] Clean up Python/thread_*.h ?
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]