branch-0.9

RAPIDS Notebooks and Utilities

XGBoost Notebook

FolderNotebook TitleDescription
XGBoostXGBoost DemoThis notebook shows the acceleration one can gain by using GPUs with XGBoost in RAPIDS.

CuML Notebooks

The cuML notebooks showcase how to use the machine learning algorithms implemented in cuML along with the advantages of using cuML over scikit-learn. These notebooks compare the time required and the performance of the algorithms. Below are a list of such algorithms:

FolderNotebook TitleDescription
cuMLdbscan_demoThis notebook showcases density-based spatial clustering of applications with noise (dbscan) algorithm using the fit and predict functions
cuMLknn_demoThis notebook showcases k-nearest neighbors (knn) algorithm using the fit and kneighbors functions
cuMLLinear Regression DemoThis notebook includes code example for linear regression algorithm and it showcases the fit and predict functions.
cuMLRidge Regression DemoThis notebook includes code examples of ridge regression and it showcases the fit and predict functions.
cuMLCoordinate DescentThis notebook includes code examples of lasso and elastic net models. These models are placed together so a comparison between the two can also be made in addition to their sklearn equivalent.
cuMLpca_demoThis notebook showcases principal component analysis (PCA) algorithm where the model can be used for prediction (using fit_transform) as well as converting the transformed data into the original dataset (using inverse_transform).
cuMLtsvd_demoThis notebook showcases truncated singular value decomposition (tsvd) algorithm which like PCA performs both prediction and transformation of the converted dataset into the original data using fit_transform and inverse_transform functions respectively
cuMLsgd_demoThe stochastic gradient descent algorithm is demostrated in the notebook using fit and predict functions
cuMLumap_demoThe uniform manifold approximation & projection algorithm is compared with the original author's equivalent non-GPU \Python implementation using fit and transform functions
cuMLumap_demo_graphedDemonstration of cuML uniform manifold approximation & projection algorithm's supervised approach against mortgage dataset and comparison of results against the original author's equivalent non-GPU \Python implementation.
cuMLumap_demo_supervisedDemostration of UMAP supervised training. Uses a set of labels to perform supervised dimensionality reduction. UMAP can also be trained on datasets with incomplete labels, by using a label of "-1" for unlabeled samples.
cuMLrandom forestThis notebook includes code examples of Random Forest and it showcases the fit and predict functions.
cuMLTSNEShowcases cuML's super fast Barnes Hut implementation of TSNE on MNIST, Fashion MNIST and other sklearn baseline datasets. Also describes some of the algorithmic optimizations, pickling methods and timings compared to sklearn.

CuDF Notebooks

FolderNotebook TitleDescription
cuDFnotebooks_Apply_Operations_in_cuDFThis notebook showcases two special methods where cuDF goes beyond the Pandas library: apply_rows and apply_chunk functions. They utilized the Numba library to accelerate the data transformation via GPU in parallel.
cuDFnotebooks_numba_cuDF_integrationThis notebook showcases how to use Numba CUDA to accelerate cuDF data transformation and how to step by step accelerate it using CUDA programming tricks

CuGraph Notebooks

FolderNotebook TitleDescription
cuGraphLouvainDemonstration of using cuGraph to identify clusters in a test graph using the Louvain algorithm
cuGraphVertex-SimilarityDemonstration of using cuGraph to compute vertex similarity using both the Jaccard Similarity and the Overlap Coefficient.
cuGraphWeighted-JaccardDemonstration of using cuGraph to compute the Weighted Jaccard Similarity metric on our training dataset.
cuGraphRenumberDemonstrate of using the renumbering features to assigned new vertex IDs to the test graph. This is useful for when the data sets is non-contiguous or not integer values
cuGraphBFSDemonstration of using cuGraph to computer the Bredth First Search space from a given vertex to all other in our training graph
cuGraphSSSPDemonstration of using cuGraph to computer the The Shortest Path from a given vertex to all other in our training graph
cuGraphSpectral-ClusteringDemonstration of using cuGraph to identify clusters in a test graph using Spectral Clustering using both the (A) Balance Cut and (B) the Modularity Maximization quality metrics
cuGraphPagerankDemonstration of using both NetworkX and cuGraph to compute the PageRank of each vertex in our test dataset
cuGraphTriangle CountingDemonstration of using both NetworkX and cuGraph to compute the the number of Triangles in our test dataset

Tutorial with an End to End workflow

FolderNotebook TitleDescription
TutorialsDBSCAN_demo_fullDemonstration of how to use DBSCAN - a popular clustering algorithm - and how to use the GPU accelerated implementation of this algorithm in RAPIDS.

Utils Scripts

FolderScript TitleDescription
Utilsstart-jupyter.shstarts a JupyterLab environment for interacting with, and running, notebooks
Utilsstop-jupyter.shidentifies all process IDs associated with Jupyter and kills them
Utilsdask-cluster.pylaunches a configured Dask cluster (a set of nodes) for use within a notebook
Utilsdask-setup.sha low-level script for constructing a set of Dask workers on a single node
Utilssplit-data-mortgage.shsplits mortgage data files into smaller parts, and saves them for use with the mortgage notebook

Documentation (WIP)

FolderDocument TitleDescription
Docsngc-readme
Docsdockerhub-readme

Additional Information

  • The cuml folder also includes a small subset of the Mortgage Dataset used in the notebooks and the full image set from the Fashion MNIST dataset.

  • utils: contains a set of useful scripts for interacting with RAPIDS

  • For additional, community driven notebooks, which will include our blogs, tutorials, workflows, and more intricate examples, please see the Notebooks Extended Repo