BUG read_csv(quotechar=, engine='pyarrow') (#56352) · pandas-dev/pandas@1000000 (original) (raw)

3 files changed

lines changed

Original file line number Diff line number Diff line change
@@ -598,6 +598,7 @@ I/O
598 598 - Bug in :func:`read_csv` where ``engine="python"`` did not respect ``chunksize`` arg when ``skiprows`` was specified. (:issue:`56323`)
599 599 - Bug in :func:`read_csv` where ``engine="python"`` was causing a ``TypeError`` when a callable ``skiprows`` and a chunk size was specified. (:issue:`55677`)
600 600 - Bug in :func:`read_csv` where ``on_bad_lines="warn"`` would write to ``stderr`` instead of raise a Python warning. This now yields a :class:`.errors.ParserWarning` (:issue:`54296`)
601 +- Bug in :func:`read_csv` with ``engine="pyarrow"`` where ``quotechar`` was ignored (:issue:`52266`)
601 602 - Bug in :func:`read_csv` with ``engine="pyarrow"`` where ``usecols`` wasn't working with a csv with no headers (:issue:`54459`)
602 603 - Bug in :func:`read_excel`, with ``engine="xlrd"`` (``xls`` files) erroring when file contains NaNs/Infs (:issue:`54564`)
603 604 - Bug in :func:`read_json` not handling dtype conversion properly if ``infer_string`` is set (:issue:`56195`)
Original file line number Diff line number Diff line change
@@ -65,6 +65,7 @@ def _get_pyarrow_options(self) -> None:
65 65 "escapechar": "escape_char",
66 66 "skip_blank_lines": "ignore_empty_lines",
67 67 "decimal": "decimal_point",
68 +"quotechar": "quote_char",
68 69 }
69 70 for pandas_name, pyarrow_name in mapping.items():
70 71 if pandas_name in self.kwds and self.kwds.get(pandas_name) is not None:
Original file line number Diff line number Diff line change
@@ -66,7 +66,6 @@ def test_quote_char_basic(all_parsers):
66 66 tm.assert_frame_equal(result, expected)
67 67
68 68
69 -@xfail_pyarrow # ValueError: The 'quoting' option is not supported
70 69 @pytest.mark.parametrize("quote_char", ["~", "*", "%", "$", "@", "P"])
71 70 def test_quote_char_various(all_parsers, quote_char):
72 71 parser = all_parsers