datasets

Get Dataset Processing Status

Get item-level processing status for a dataset.

GET /status reports whether a pipeline run is in progress or done for a dataset. This endpoint answers the finer question operators need when triaging incremental loads: which of the dataset’s data items carry the per-item completion stamp for a pipeline, and which are still pending.

Path Parameters

dataset_id (UUID): The unique identifier of the dataset

Query Parameters

pipeline (str, optional): Pipeline name to inspect. Defaults to cognify_pipeline.

Response

total: Number of data items in the dataset
completed: Items whose per-item status for the pipeline is completed (both the legacy string and the dict status representation are recognised)
pending: total - completed
items: [{id, name, completed}], one entry per data item, in the same order as GET /datasets/{id}/data. id is the data_id accepted by DELETE /datasets/{id}/data/{data_id} and forget(data_id=...)

Per-item errored state is not persisted, so it is not reported: a pending item may be untouched, in progress, or failed.

Error Codes

404 Not Found: Dataset doesn’t exist or user doesn’t have access
409 Conflict: Error computing the status

GET

api

datasets

{dataset_id}

processing-status

Get Dataset Processing Status

curl --request GET \
  --url https://{tenant}.aws.cognee.ai/api/v1/datasets/{dataset_id}/processing-status \
  --header 'Authorization: Bearer <token>'

import requests

url = "https://{tenant}.aws.cognee.ai/api/v1/datasets/{dataset_id}/processing-status"

headers = {"Authorization": "Bearer <token>"}

response = requests.get(url, headers=headers)

print(response.text)

{
  "total": 123,
  "completed": 123,
  "pending": 123,
  "items": [
    {
      "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
      "name": "<string>",
      "completed": true
    }
  ]
}

{
  "message": "<string>"
}

{
  "detail": [
    {
      "loc": [
        "<string>"
      ],
      "msg": "<string>",
      "type": "<string>",
      "input": "<unknown>",
      "ctx": {}
    }
  ]
}

Authorizations

Authorization

string

header

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

dataset_id

string<uuid>

required

Dataset UUID, the id field from GET /api/v1/datasets (not the name)

Example:

"b8a7c3de-4f5a-4b6c-8d9e-0f1a2b3c4d5e"

Query Parameters

pipeline

string

default:cognify_pipeline

Pipeline whose per-item completion to count: 'cognify_pipeline' (default), 'add_pipeline', or 'code_graph_pipeline'.

Example:

"cognify_pipeline"

Response

Successful Response

Item-level completion counts for one dataset and one pipeline.

total

integer

required

Number of data items in the dataset

completed

integer

required

Items carrying the per-item completion stamp

pending

integer

required

Items without the stamp (total - completed)

items

DataItemProcessingStatusDTO · object[]

required

One entry per data item, in the same order as GET /datasets/{id}/data

Show child attributes

⌘I

Get Dataset Processing Status

curl --request GET \
  --url https://{tenant}.aws.cognee.ai/api/v1/datasets/{dataset_id}/processing-status \
  --header 'Authorization: Bearer <token>'

import requests

url = "https://{tenant}.aws.cognee.ai/api/v1/datasets/{dataset_id}/processing-status"

headers = {"Authorization": "Bearer <token>"}

response = requests.get(url, headers=headers)

print(response.text)

{
  "total": 123,
  "completed": 123,
  "pending": 123,
  "items": [
    {
      "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
      "name": "<string>",
      "completed": true
    }
  ]
}

{
  "message": "<string>"
}

{
  "detail": [
    {
      "loc": [
        "<string>"
      ],
      "msg": "<string>",
      "type": "<string>",
      "input": "<unknown>",
      "ctx": {}
    }
  ]
}