Issue 36246: csv.writer lineterminator affects csv escaping (original) (raw)

Issue36246

Created on 2019-03-08 21:59 by flow2k, last changed 2022-04-11 14:59 by admin. This issue is now closed.

Messages (3)
msg337537 - (view)	Author: (flow2k)	Date: 2019-03-08 21:59
output = io.StringIO() csvData = [1, 2, 'a', 'He said "what do you mean?"', "Whoa!\rNewlines!"] writer = csv.writer(output,lineterminator='\n') writer.writerow(csvData) print(repr(output.getvalue())) #does not escape \r as expected
msg337547 - (view)	Author: Martin Panter (martin.panter) *	Date: 2019-03-09 00:09
This is the result that I see: >>> output = StringIO() >>> csv.writer(output, lineterminator='\n').writerow(["Whoa!\rNewlines!"]) 16 >>> output.getvalue() 'Whoa!\rNewlines!\n' For comparison, this is the result with CRLF terminators (the default): >>> output = StringIO() >>> csv.writer(output, lineterminator='\r\n').writerow(["Whoa!\rNewlines!"]) 19 >>> output.getvalue() '"Whoa!\rNewlines!"\r\n' Is it a problem that the line terminator determines whether the CR is quoted or not? I believe the default policy is “excel”, which happens to use QUOTE_MINIMAL. This behaviour is documented: <https://docs.python.org/3.7/library/csv.html#csv.QUOTE_MINIMAL>.
msg338016 - (view)	Author: (flow2k)	Date: 2019-03-15 19:02
Okay, thanks for pointing to the doc. I did not expect the line termination to affect escaping, but I can see why these may be related. Per your comment, I've added quoting=csv.QUOTE_NONNUMERIC. Instead of Excel, I am using Gdocs, and this escaping enables Gsheets to ingest it. Closing the issue...