CINECA IRIS Institutional Research Information System
IRIS è la soluzione IT che facilita la raccolta e la gestione dei dati relativi alle attività e ai prodotti della ricerca. Fornisce a ricercatori, amministratori e valutatori gli strumenti per monitorare i risultati della ricerca, aumentarne la visibilità e allocare in modo efficace le risorse disponibili.
EnglishRandom Forests (RF) of tree classifiers are a popular ensemble method for classification. RF are usually preferred with respect to other classification techniques because of their limited hyperparameter sensitivity, high numerical robustness, native capacity of dealing with numerical and categorical features, and effectiveness in many real world classification problems. In this work we present ReForeSt, a Random Forests Apache Spark implementation which is easier to tune, faster, and less memory consuming with respect to MLlib, the de facto standard Apache Spark machine learning library. We perform an extensive comparison between ReForeSt and MLlib by taking advantage of the Google Cloud Platform (https://cloud.google.com). In particular, we test ReForeSt and MLlib with different library settings, on different real world datasets, and with a different number of machines equipped with different number of cores. Results confirm that ReForeSt outperforms MLlib in all the above mentioned aspects. ReForeSt is made publicly available via GitHub (https://github.com/alessandrolulli/reforest).
| Titolo: | ReForeSt: Random forests in apache spark |
| Autori: | |
| Data di pubblicazione: | 2017 |
| Serie: | |
| Handle: | http://hdl.handle.net/11567/950904 |
| ISBN: | 978-3-319-68611-0 978-3-319-68612-7 |
| Appare nelle tipologie: | 04.01 - Contributo in atti di convegno |
File in questo prodotto:
| File | Descrizione | Tipologia | |
|---|---|---|---|
| C050.pdf | Documento in Post-print | Open Access Visualizza/Apri |
http://hdl.handle.net/11567/950904
Copyright © 2021