List datasets
GET /api/v1/datasets/ — List all datasets accessible to the authenticated user.
Create a dataset
POST /api/v1/datasets/ — Create a new dataset or return the existing one if the name already exists.
Datasets are also created implicitly when you call
add or remember with a dataset_name that does not yet exist.Dataset status
GET /api/v1/datasets/status — Get the processing status of all datasets.
Returns the pipeline state for each dataset: whether cognify is pending, running, or completed.
Graph summary
GET /api/v1/datasets/graph-summary — Get node and edge counts for each dataset.
Counts are computed once per dataset’s latest cognify run and cached, so this is much cheaper than the full graph endpoint when polling dataset sizes repeatedly.
dataset_ids query parameters to summarize specific datasets. Omit it to summarize every dataset you have read access to.
- datasetId: The dataset’s UUID
- pipelineRunId: The dataset’s latest cognify run, or
nullif it has never been cognified - numNodes / numEdges: Graph size for that run
- computedAt: When the counts were cached, or
nullif they have not been computed. IfpipelineRunIdis set butcomputedAtisnull, the last count attempt failed (for example, the graph store was unavailable) and the zero counts are placeholders — the next call retries the computation.
Dataset data
GET /api/v1/datasets/{dataset_id}/data — List all data items in a dataset.
Each item also carries the label and metadata attached at upload time:
- label: The label given to this file via the
labelsfield on add or remember, ornullif none was set - externalMetadata: The stored metadata object — the
external_metadataentry you sent merged over loader-derived keys, plus anode_setkey when one was passed at ingest. A file uploaded without metadata stores an empty object rather thannull.
GET /api/v1/datasets/{dataset_id}/data/{data_id}/raw — Download the original file for a specific data item. Requires read permission on the containing dataset; ownership of the data item itself is not required, so a dataset shared with you is fully downloadable.
Delete
DELETE /api/v1/datasets/{dataset_id} — Delete a dataset and all its contents.
DELETE /api/v1/datasets/{dataset_id}/data/{data_id} — Delete a specific data item from a dataset.