https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.">

sparklyr: R Interface to Apache Spark (original) (raw)

R interface to Apache Spark, a fast and general engine for big data processing, see <https://spark.apache.org/>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Version: 1.9.0
Depends: R (≥ 3.2)
Imports: config (≥ 0.2), DBI (≥ 1.0.0), dbplyr (≥ 2.5.0), dplyr (≥ 1.0.9), generics, globals, glue, httr (≥ 1.2.1), jsonlite (≥ 1.4), methods, openssl (≥ 0.8), purrr, rlang (≥ 0.1.4), rstudioapi (≥ 0.10), tidyr (≥ 1.2.0), tidyselect, uuid, vctrs, withr, xml2
Suggests: arrow (≥ 0.17.0), broom, diffobj, foreach, ggplot2, iterators, janeaustenr, Lahman, mlbench, nnet, nycflights13, R6, r2d3, RCurl, reshape2, shiny (≥ 1.0.1), parsnip, testthat, rprojroot
Published: 2025-03-18
DOI: 10.32614/CRAN.package.sparklyr
Author: Javier Luraschi [aut], Kevin Kuo ORCID iD [aut], Kevin Ushey [aut], JJ Allaire [aut], Samuel Macedo [ctb], Hossein Falaki [aut], Lu Wang [aut], Andy Zhang [aut], Yitao Li ORCID iD [aut], Jozef Hajnala [ctb], Maciej SzymkiewiczORCID iD [ctb], Wil Davis [ctb], Edgar Ruiz [aut, cre], RStudio [cph], The Apache Software Foundation [aut, cph]
Maintainer: Edgar Ruiz
BugReports: https://github.com/sparklyr/sparklyr/issues
License: Apache License 2.0 | file
URL: https://spark.posit.co/
NeedsCompilation: no
SystemRequirements: Spark: 2.x, or 3.x, or 4.x
Materials: README NEWS
In views: Databases, ModelDeployment
CRAN checks: sparklyr results

Documentation:

Downloads:

Reverse dependencies:

Reverse depends: s3.resourcer
Reverse imports: apache.sedona, catalog, geospark, graphframes, MSstatsBig, pathling, pysparklyr, rollup, rsparkling, shinyML, spark.sas7bdat, sparkavro, sparkbq, sparkhail, sparklyr.flint, sparklyr.nested, sparktf, sparkwarc, sparkxgb, variantspark
Reverse suggests: butcher, corrr, finnts, mlflow, modeltime, orbital, parsnip, pointblank, resourcer
Reverse enhances: vip

Linking:

Please use the canonical formhttps://CRAN.R-project.org/package=sparklyrto link to this page.