BUG: No kwargs in df.apply(raw=True, engine="numba") · Issue #58712 · pandas-dev/pandas (original) (raw)

Pandas version checks

Reproducible Example

import pandas as pd

df = pd.DataFrame(np.nan, index=[1,2,3], columns=list("abc")) df.apply(np.nanquantile, q=0.5, raw=True, engine="numba")

Issue Description

related: #55753
the above code raises missing a required argument: 'q':

TypingError: Failed in nopython mode pipeline (step: nopython frontend)
No implementation of function Function(<function nanquantile at 0x7fbde03c2b00>) found for signature:
 
 >>> nanquantile(array(float64, 1d, A))
 
There are 6 candidate implementations:
    - Of which 4 did not match due to:
    Overload in function 'register_quantile_function.<locals>.np_quantile': File: ../../../../../../Techfin/PublicPackages/TechFinDataRAD/rd/_deps/commons/numba_overloads/overloads.py: Line 152.
      With argument(s): '(array(float64, 1d, A))':
     Rejected as the implementation raised a specific error:
       TypingError: missing a required argument: 'q'
  raised from /home/auderson/mambaforge/envs/py3.10/lib/python3.10/site-packages/numba/core/typing/templates.py:784
    - Of which 2 did not match due to:
    Overload in function 'register_jitable.<locals>.wrap.<locals>.ov_wrap': File: numba/core/extending.py: Line 161.
      With argument(s): '(array(float64, 1d, A))':
     Rejected as the implementation raised a specific error:
       AssertionError: Implementation function returned by `@overload` has an unexpected type.  Got <function nanquantile at 0x7fbde03c2b00>
  raised from /home/auderson/mambaforge/envs/py3.10/lib/python3.10/site-packages/numba/core/typing/templates.py:807

During: resolving callee type: Function(<function nanquantile at 0x7fbde03c2b00>)
During: typing of call at /home/auderson/mambaforge/envs/py3.10/lib/python3.10/site-packages/pandas/core/_numba/executor.py (36)


File "../../../../../mambaforge/envs/py3.10/lib/python3.10/site-packages/pandas/core/_numba/executor.py", line 36:
    def nb_looper(values, axis):
        <source elided>
            dim0 = values.shape[0]
        res0 = nb_compat_func(first_elem)
        ^

Expected Behavior

kwargs should be passed to njit func

Installed Versions

/home/auderson/mambaforge/envs/py3.10/lib/python3.10/site-packages/_distutils_hack/init.py:26: UserWarning: Setuptools is replacing distutils.
warnings.warn("Setuptools is replacing distutils.")

INSTALLED VERSIONS

commit : d9cdd2e
python : 3.10.13.final.0
python-bits : 64
OS : Linux
OS-release : 5.15.0-101-generic
Version : #111-Ubuntu SMP Tue Mar 5 20:16:58 UTC 2024
machine : x86_64
processor : x86_64
byteorder : little
LC_ALL : None
LANG : en_US.UTF-8
LOCALE : en_US.UTF-8

pandas : 2.2.2
numpy : 1.26.4
pytz : 2024.1
dateutil : 2.8.2
setuptools : 69.1.0
pip : 24.0
Cython : 3.0.7
pytest : 8.0.2
hypothesis : None
sphinx : 7.2.6
blosc : None
feather : None
xlsxwriter : None
lxml.etree : None
html5lib : None
pymysql : 1.4.6
psycopg2 : 2.9.9
jinja2 : 3.1.3
IPython : 8.22.1
pandas_datareader : None
adbc-driver-postgresql: None
adbc-driver-sqlite : None
bs4 : 4.12.3
bottleneck : None
dataframe-api-compat : None
fastparquet : None
fsspec : 2024.3.1
gcsfs : None
matplotlib : 3.8.3
numba : 0.59.0
numexpr : 2.9.0
odfpy : None
openpyxl : None
pandas_gbq : None
pyarrow : 15.0.0
pyreadstat : None
python-calamine : None
pyxlsb : None
s3fs : None
scipy : 1.12.0
sqlalchemy : 2.0.27
tables : 3.9.2
tabulate : None
xarray : None
xlrd : None
zstandard : 0.22.0
tzdata : 2024.1
qtpy : 2.4.1
pyqt5 : None