Complexity sciences

it's a shift in the way scientists think

Self-Dissimilarity: An Empirical Measure of Complexity

David H. Wolpert,William G. Macready
1998.

Presented at NECSI First Annual Conference on Complex Systems
For systems usually characterized as complex/living/intelligent, the spatiotemporal patterns exhibited on different scales differ markedly from one another. (E.g., the biomass distribution of the human body looks very different depending on the spatial scale at which one examines that biomass.) Conversely, the density patterns at different scales in nonliving/simple systems (e.g., gases, mountains, crystal) do not vary significantly from one another. Such self-dissimilarity can be empirically measured on almost any real-world data set involving spatiotemporal densities, be they mass densities, species densities, or symbol densities. Accordingly, taking a system's (empirically measureable) self-dissimilarity over various scales as a complexity "signature" of the system, we can compare the complexity signatures of wholly different kinds of systems (e.g., systems involving information density in a digital computer vs. systems involving species densities in a rainforest vs. capital density in an economy, etc.) Signatures can also be clustered to provide an empirically determined taxonomy of kinds of systems that share organizational traits. Many of our candidate self-dissimilarity measures can also be calculated (or at least approximated) for physical models. The measure of self-dissimilarity between two scales that we finally choose is the amount of extra information on one of the scales beyond that which exists on the other scale. It is natural to determine this "added information" using a maximum entropy inference of the pattern at the second scale based on the provided pattern at the first scale. We briefly discuss using our measure with other inference mechanisms (e.g., Kolmogorov complexity-based inference, fractal-dimension preserving inference, etc.)