​
Descriptive Metrics

​
Metrics

Below is a list of descriptive metrics calculated for graph correctness and quality assessment. All calculations convert the graph into an undirected graph, meaning edge direction is not considered in path-related metrics.

​
1. Token & Graph Size Metrics

  • num_tokens: Total number of tokens in the input text.
  • num_nodes: Total number of nodes (entities) in the knowledge graph.
  • num_edges: Total number of edges (relationships) connecting nodes.

​
2. Connectivity & Density Metrics

  • mean_degree: Average number of edges per node.
  • edge_density: Ratio of existing edges to the maximum possible edges, measuring graph sparsity.
  • num_connected_components: Number of connected components; higher values may indicate fragmentation.
  • sizes_of_connected_components: Number of nodes in each connected component.

​
3. Structural Integrity Metrics

  • num_selfloops: Number of self-loops (nodes connected to themselves); may indicate errors.
  • diameter: The longest shortest path between any two nodes in the graph.
  • avg_shortest_path_length: The average shortest path between all node pairs, indicating graph efficiency.
  • avg_clustering: Average clustering coefficient, measuring the likelihood of nodes forming tightly connected groups.

​
Interpreting the Metrics

When analyzing these metrics, certain extreme values may indicate potential issues, e.g.:
  • Number of input tokens in relation to graph size : Large input documents with only a few generated nodes indicates discrepancy.
  • Mean Degree : A value of 1 suggests an extremely sparse graph, while a value too close to num_nodes suggests excessive connectivity. Since multiple edges can exist between two nodes, it is possible for the mean degree to be higher than num_nodes, but an unusually high value should be investigated.
  • Diameter: Extreme values such as 1 (a fully connected graph) or num_nodes-1 (a path) clearly indicate issues.
The following table presents examples of graphs with 50 nodes that exhibit extreme values for diameter and mean degree. These cases illustrate how structural properties can vary widely, from highly connected graphs with small diameters to sparse graphs with minimal connectivity — configurations that are unlikely to correspond to real-world knowledge graphs, which typically balance connectivity and semantic structure to preserve meaningful relationships.
Too denseCorrectToo sparse
Mean degree493.521.96
Diameter1949
Fully connected graphCorrect graphPath

​
Tracking Changes Over Time:

Beyond analyzing static graphs, monitoring how these metrics evolve over time can reveal important insights about structural shifts. Unexpected deviations may indicate potential issues.
  • Adding new data should increase the number of nodes.
  • Adding information about existing entities should increase the number of edges and edge density.
  • If new data is loosely related to existing data, the diameter may increase.
  • If new data strengthens existing entity relationships, the diameter may decrease.
For a quick visual explanation of these graph metrics and their implications, click here For generating graph metrics, see our Descriptive Metrics documentation.