truelabel

DATASET METHODOLOGY

How dataset source facts are checked

One method covers the Hugging Face dataset profiles: use explicit source metadata, preserve missing fields, and label failed fetches.

DIRECT ANSWER

Each profile reads a committed snapshot of the dataset's own Hugging Face API record. The snapshot records license, size category, downloads, creator namespace, and linked arXiv ids. A missing value is shown as not provided. A failed fetch is shown as unverified. Neither state is replaced with a guessed license.

SOURCE ORDER

What is copied into a profile

The refresh job requests the per-dataset API endpoint. It reads an explicit cardData.license value first, then an explicitlicense: tag. Some gated cards put the license in their access agreement; in that case the job accepts only a named license or an official license link in that text. Size comes fromcardData.size_categories or its matching tag. Downloads and creator come from the API record. Papers come only from explicitarxiv: tags.

The generated JSON is committed with the application. Page builds do not call Hugging Face, so a network outage cannot change a build or silently replace source facts. A later refresh can update the snapshot and make the resulting diff reviewable.

MISSING VS UNVERIFIED

Two states that must stay distinct

Fetch succeeded

Not provided

The API record was retrieved, but the requested field was absent. This does not prove that no license, paper, or size statement exists elsewhere.

Fetch failed

Unverified

The per-dataset request failed or was access-restricted. The profile labels the source facts unverified and links to the live record for review.

HOW TO USE THE FACTS

License, size, downloads, and commercial use

A license name is reported as source metadata, not as a complete rights opinion. A license marked non-commercial is labeled as a commercial-use restriction. Other licenses still need review of the linked terms, upstream sources, and the intended use. When no license is provided, commercial use is not established.

Size categories and download counts are discovery facts, not quality scores. Before using a dataset, inspect the current card and files, confirm the relevant modalities and formats, and test a representative sample. Related pages are alternatives for source review; shared tags do not prove that two datasets are equivalent.

Where to go next

Sources