Skip to main content

Demo Datasets

The SQL examples on the function pages read one of four public datasets. Each page below converts the upstream files into local Parquet, registers the tables in a running server, and records the captured runs. The website does not host raw or converted data; every preparation runs in your repository checkout.

Every dataset page uses the same sections in the same order: At a glance, Examples, Prepare the data, Start the server, Register the tables, Run the examples, Tables, and Captured run where a capture record exists.

DatasetDomainSize used by the examplesExamples
Citation NetworkDBLP / AMiner V12 papers, April 2020 snapshot4.9M papers, 45.6M citation edgesEvery cuGraph function; embedded backend and Flight SQL setup
Amazon ReviewsAmazon Reviews 2023, Electronics43.9M reviews, 1.6M products; 1,024-dim BGE-M3 vectors for 1M products and 1M reviewscuVS brute-force KNN, KMeans, Top-K; cuML UMAP
EMBER2024Malware benchmark feature vectors6,315 challenge files (3,225 Win32); 1% SHA-256 samples of train and testcuML, cuVS, and cuGraph
MerRec MarketplaceMercari US marketplace events, October 2023One shard: 494,357 events, 358,893 items, 5,660 userscuGraph, cuML, and cuVS

Choosing a dataset​

Start with the Citation Network for a first run. It needs only pyarrow for conversion, and its server walkthrough is the one the integration pages reuse. Conversion takes a 12.5 GB source JSON and about 17 to 19 minutes on a 32-core host.

Amazon Reviews is the largest preparation. Embedding the text runs PyTorch on the GPU before any SQL, and the captured server configuration gives each query a 32 GiB limit on a device with at least 64 GiB available.

EMBER2024 and MerRec exercise more than one algorithm family against the same tables. Their preparation scripts also build derived relations, such as forest attributions or browsing-transition graphs, that some examples read.

Server and table lifetime​

Table registrations last until the server stops. After a restart, rerun the dataset's registration step; the Parquet files can be reused.

Each page starts a server with the configuration used for its captures. Amazon Reviews and EMBER2024 both bind port 50062, so stop one server before starting the other. For other settings, see Flight SQL server and configuration.