GitHub - online-ml/river: 🌊 Online machine learning in Python (original) (raw)

River is a Python library for online machine learning. It aims to be the most user-friendly library for doing machine learning on streaming data. River is the result of a merger between creme and scikit-multiflow.

⚡️ Quickstart

As a quick example, we'll train a logistic regression to classify the website phishing dataset. Here's a look at the first observation in the dataset.

from pprint import pprint from river import datasets

dataset = datasets.Phishing()

for x, y in dataset: ... pprint(x) ... print(y) ... break {'age_of_domain': 1, 'anchor_from_other_domain': 0.0, 'empty_server_form_handler': 0.0, 'https': 0.0, 'ip_in_url': 1, 'is_popular': 0.5, 'long_url': 1.0, 'popup_window': 0.0, 'request_from_other_domain': 0.0} True

Now let's run the model on the dataset in a streaming fashion. We sequentially interleave predictions and model updates. Meanwhile, we update a performance metric to see how well the model is doing.

from river import compose from river import linear_model from river import metrics from river import preprocessing

model = compose.Pipeline( ... preprocessing.StandardScaler(), ... linear_model.LogisticRegression() ... )

metric = metrics.Accuracy()

for x, y in dataset: ... y_pred = model.predict_one(x) # make a prediction ... metric.update(y, y_pred) # update the metric ... model.learn_one(x, y) # make the model learn

metric Accuracy: 89.28%

Of course, this is just a contrived example. We welcome you to check the introduction section of the documentation for a more thorough tutorial.

🛠 Installation

River is intended to work with Python 3.10 and above. Installation can be done with pip:

There are wheels available for Linux, MacOS, and Windows. This means you most probably won't have to build River from source.

You can install the latest development version from GitHub as so:

pip install git+https://github.com/online-ml/river --upgrade pip install git+ssh://git@github.com/online-ml/river.git --upgrade # using SSH

This method requires having Cython and Rust installed on your machine.

🔮 Features

River provides online implementations of the following family of algorithms:

Linear models, with a wide array of optimizers
Decision trees and random forests
(Approximate) nearest neighbors
Anomaly detection
Drift detection
Recommender systems
Time series forecasting
Bandits
Factorization machines
Imbalanced learning
Clustering
Bagging/boosting/stacking
Active learning

River also provides other online utilities:

Feature extraction and selection
Online statistics and metrics
Preprocessing
Built-in datasets
Progressive model validation
Model pipelines

Check out the API for a comprehensive overview

🤔 Should I be using River?

You should ask yourself if you need online machine learning. The answer is likely no. Most of the time batch learning does the job just fine. An online approach might fit the bill if:

You want a model that can learn from new data without having to revisit past data.
You want a model which is robust to concept drift.
You want to develop your model in a way that is closer to what occurs in a production context, which is usually event-based.

Some specificities of River are that:

It focuses on clarity and user experience, more so than performance.
It's very fast at processing one sample at a time. Try it, you'll see.
It plays nicely with the rest of Python's ecosystem.

🔗 Useful links

👐 Contributing

Feel free to contribute in any way you like, we're always open to new ideas and approaches.

Open a discussion if you have any question or enquiry whatsoever. It's more useful to ask your question in public rather than sending us a private email. It's also encouraged to open a discussion before contributing, so that everyone is aligned and unnecessary work is avoided.
Feel welcome to open an issue if you think you've spotted a bug or a performance issue.
Our roadmap is public. Feel free to work on anything that catches your eye, or to make suggestions.

Please check out the contribution guidelines if you want to bring modifications to the code base.

🤝 Affiliations

💬 Citation

If River has been useful to you, and you would like to cite it in a scientific publication, please refer to the paper published at JMLR:

@article{montiel2021river, title={River: machine learning for streaming data in Python}, author={Montiel, Jacob and Halford, Max and Mastelini, Saulo Martiello and Bolmier, Geoffrey and Sourty, Raphael and Vaysse, Robin and Zouitine, Adil and Gomes, Heitor Murilo and Read, Jesse and Abdessalem, Talel and others}, year={2021} }

📝 License

River is free and open-source software licensed under the 3-clause BSD license.