Scant Evidence of Power Laws Found in Real-World Networks
础听听last month has reignited a debate about one of the oldest, most startling claims in the modern era of network science: the proposition that most complex networks in the real world 鈥 from the World Wide Web to interacting proteins in a cell 鈥 are 鈥渟cale-free.鈥 Roughly speaking, that means that a few of their nodes should have many more connections than others, following a mathematical formula called a power law, so that there鈥檚 no one scale that characterizes the network.
Purely random networks do not obey power laws, so when the early proponents of the scale-free paradigm started seeing power laws in real-world networks in the late 1990s, they viewed them as evidence of a universal organizing principle underlying the formation of these diverse networks. The architecture of scale-freeness, researchers argued, could provide insight into fundamental questions such as how likely a virus is to cause an epidemic, or how easily hackers can disable a network.
Over the past two decades, an avalanche of papers has asserted the scale-freeness of hundreds of real-world networks. In 2002,听听鈥 a physicist-turned-network scientist who pioneered the scale-free networks paradigm 鈥 wrote a book for a general audience,听Linked, in which he asserted that power laws are ubiquitous in complex networks.
Real-world networks exhibit a rich structural diversity that will likely require new ideas and mechanisms to explain.
Anna Broido and Aaron Clauset
鈥淎mazingly simple and far-reaching natural laws govern the structure and evolution of all the complex networks that surround us,鈥 wrote Barab谩si (who is now at Northeastern University in Boston) in听Linked. He later added: 鈥淯ncovering and explaining these laws has been a fascinating roller coaster ride during which we have learned more about our complex, interconnected world than was known in the last hundred years.鈥
But over the years, other researchers have questioned both the pervasiveness of scale-freeness and the extent to which the paradigm illuminates the structure of specific networks. Now, the new paper reports that few real-world networks show convincing evidence of scale-freeness.
In a statistical analysis of nearly 1,000 networks drawn from biology, the social sciences, technology and other domains, researchers found that only about 4 percent of the networks (such as certain metabolic networks in cells) passed the paper鈥檚 strongest tests. And for 67 percent of the networks, including Facebook friendship networks, food webs and water distribution networks, the statistical tests rejected a power law as a plausible description of the network鈥檚 structure.
鈥淭hese results undermine the universality of scale-free networks and reveal that real-world networks exhibit a rich structural diversity that will likely require new ideas and mechanisms to explain,鈥 wrote the study鈥檚 authors,听Anna Broido听补苍诲听Aaron Clauset听of the University of Colorado, 麻豆影院.
Network scientists agree, by and large, that the paper鈥檚 analysis is statistically sound. But when it comes to interpreting its findings, the paper seems to be functioning like a Rorschach test, in which both proponents and critics of the scale-free paradigm see what they already believed to be true. Much of the discussion has played out in听.
Supporters of the scale-free viewpoint, many of whom came to network science by way of physics, argue that scale-freeness is intended as an idealized model, not something that precisely captures the behavior of real-world networks. Many of the most important properties of scale-free networks, they say, also hold for a broader class called 鈥渉eavy-tailed networks鈥 to which many real-world networks may belong (these are networks that have significantly more highly connected hubs than a random network has, but don鈥檛 necessarily obey a strict power law).
Critics object that terms like 鈥渟cale-free鈥 and 鈥渉eavy-tailed鈥 are bandied about in the network science literature in such vague and inconsistent ways as to make the subject鈥檚 central claims unfalsifiable.
The new paper 鈥渨as an attempt to take a data-driven approach to sort of clean up this question,鈥 Clauset said.
Network science is a young discipline 鈥 most of its papers date to the last 20 years 鈥 and the contentiousness surrounding the paper and the very vocabulary of scale-freeness stems from the field鈥檚 immaturity, said听, a mathematician and network scientist at the University of California, Los Angeles. Network science, he said, is 鈥渟till kind of in the Wild West.鈥
A Universal Law?
Many networks, from perfectly ordered lattices to purely random networks, do have a characteristic scale. In a two-dimensional square lattice, for instance, every node is connected to exactly four other nodes (so mathematicians say the node鈥檚 鈥渄egree鈥 is four). In a random network, in which each pair of nodes has some constant probability of being connected to each other, different nodes can have different degrees, but these degrees nevertheless cluster fairly close to the average. The distribution of degrees is shaped roughly like a bell curve, and nodes with a disproportionately large number of links essentially never occur, just as the distribution of people鈥檚 heights is clustered in the 5- to 6-foot range and no one is a million (or even 10) feet tall.
But when a team led by Barab谩si examined a sample of the World Wide Web in 1998, it saw something very different: some web pages, such as the Google and Yahoo home pages, were linked to vastly more often than others. When the researchers plotted a histogram of the nodes鈥 degrees, it appeared to follow the shape of a power law, meaning that the probability that a given node had degree听k听was proportional to 1/kraised to a power. (In the case of incoming links in the World Wide Web, this power was approximately 2, the team reported.)
In a power law distribution, there is no characteristic scale (thus the name 鈥渟cale-free鈥). A power law has no peak 鈥 it simply decreases for higher degrees, but relatively slowly, and if you zoom in on different sections of its graph, they look self-similar. As a result, while most nodes still have low degree, hubs with an enormous number of links do appear in small quantities, at every scale.
The scale-free paradigm in networks emerged at a historical moment when power laws had taken on an outsize role in statistical physics. In the 1960s and 1970s they had played a key part in universal laws that underlie phase transitions in a wide range of physical systems, a finding that earned Kenneth Wilson the听. Soon after, power laws formed the core of two other paradigms that swept across the statistical physics world: fractals, and a theory about organization in nature called听.
By the time Barab谩si was turning his attention to networks in the mid-1990s, statistical physicists were primed to see power laws everywhere, said听, a mathematician at Cornell University (and a member of听Quanta鈥檚听). In physics, he said, there鈥檚 a 鈥減ower law religion.鈥
There was a bandwagon effect in which people were doing stuff rather indiscriminately.
Mason Porter
Barab谩si鈥檚 team听听颈苍听Nature听in 1999; a month later, Barab谩si and his then-graduate student听听(now a network scientist at Pennsylvania State University)听,听in a paper that has since been cited more than 30,000 times, that power laws describe the structure not just of the World Wide Web but also of many other networks, including the collaboration network of movie actors, the electrical power grid of the Western United States, and the citation network of scientific papers. Most complex networks, Barab谩si asserted a few years later in听Linked, obey a power law, whose exponent is usually between 2 and 3.
A simple mechanism called 鈥減referential attachment,鈥 Albert and Barab谩si argued, explains why these power laws appear: When a new node joins a network, it is more likely to connect to a conspicuous, high-degree node than an obscure, low-degree node. In other words, the rich get richer and the hubs get hubbier.
Scale-free networks, Barab谩si鈥檚 team wrote in the听, have some key properties that distinguish them from other networks: They are simultaneously robust against failure of most of the nodes and vulnerable to targeted attacks against the hubs. The cover of听Nature听trumpeted this last property as the 鈥淎chilles鈥 heel of the internet鈥 (a characterization that has since been听by internet experts).
Barab谩si鈥檚 work electrified many mathematicians, physicists and other scientists, and was instrumental in launching the modern field of network science. It unleashed a torrent of papers asserting that one real-world network after another was scale-free 鈥 a sort of preferential attachment in which Barab谩si鈥檚 early papers became the hubs. 鈥淭here was a bandwagon effect in which people were doing stuff rather indiscriminately,鈥 Porter said. The excitement spilled over into the popular press, with talk of universal laws of nature and cover stories in听,听听and other magazines.
From the beginning, though, the scale-free paradigm also attracted pushback. Critics pointed out that preferential attachment is far from the only mechanism that can give rise to power laws, and that networks with the same power law can have very different topologies. Some network scientists and domain experts cast doubt on the scale-freeness of specific networks such as听,听听and the听.
Others objected to a lack of statistical rigor. When a power law is graphed on a 鈥渓og-log plot鈥 (in which the听x鈥 and听y-axes have logarithmic scales) it becomes a straight line. So to decide whether a network was scale-free, many early researchers simply eyeballed a log-log plot of the network鈥檚 degrees. 鈥淲e would even squint at the computer screen from an angle to get a better idea if a curve was straight or not,鈥 recalled the network scientist听of Tokyo Institute of Technology in a听.
鈥淭here must be a thousand papers,鈥 Clauset said, 鈥渋n which people plot the degree distribution, put a line through it and say it鈥檚 scale-free without really doing the careful statistical work.鈥
In response to these criticisms, over the years some of the physicists studying scale-freeness shifted their focus to the broader class of heavy-tailed networks. Even so, a steady stream of papers continued to assert scale-freeness for a growing array of networks.
And the discussion was muddied by a lack of consistency, from one paper to another, about what 鈥渟cale-free鈥 actually meant. Was a scale-free network one that obeys a power law with an exponent between 2 and 3, or one in which this power law arises out of preferential attachment? Or was it just a network that obeys some power law, or follows a power law on some scales, or something even more impressionistic?
鈥淭he lack of precision of language is a constant frustration,鈥 Porter said.
Clauset, who is active in outreach efforts, has found that many of the students he interacts with still think that the ubiquity of power laws is settled science. 鈥淚 was struck by how much confusion there was in the upcoming generation of scientists about scale-free networks,鈥 he said.
The evidence against scale-freeness was scattered across the literature, with most papers examining just a few networks at a time. Clauset was well-positioned to do something much more ambitious: His research group has spent the past few years curating a giant online compendium, the听, comprising more than 4,000 networks drawn from economics, biology, transportation and other domains.
鈥淲e听wanted to treat the hypothesis as falsifiable, and then assess the evidence across all domains,鈥 he said.
Sweeping Up the Dirt and Dust
To test the scale-free paradigm, Clauset and Broido, his graduate student, subjected nearly a thousand of the ICON networks to a series of increasingly strict statistical tests, designed to measure which (if any) of the definitions of scale-freeness could plausibly explain the network鈥檚 degree distribution. They also compared the power law to several other candidates, including an exponential distribution (which has a relatively thin tail) and a 鈥渓og-normal鈥 distribution (which has a heavier tail than an exponential distribution, but a lighter tail than a power law).
There is no general theory of networks.
Alessandro Vespignani
Broido and Clauset found that for about two-thirds of the networks, no power law fit well enough to plausibly explain the degree distribution. (That doesn鈥檛 mean the remaining one-third necessarily obey a power law 鈥 just that a power law was not ruled out.) And each of the other candidate distributions outperformed the power law on many networks, with the log normal beating the power law on 45 percent of the networks and essentially tying with it on another 43 percent.
Only about 4 percent of the networks satisfied Broido and Clauset鈥檚 strongest test, which requires, roughly speaking, that the power law should survive their goodness-of-fit test, have an exponent between 2 and 3, and beat the other four distributions.
For Barab谩si, these findings do not undermine the idea that scale-freeness underlies many or most complex networks. After all, he said, in real-world networks, a mechanism like preferential attachment won鈥檛 be the only thing going on 鈥 other processes will often nudge the network away from pure scale-freeness, making the network fail Broido and Clauset鈥檚 tests. Network scientists have already figured out how to correct for these other processes in dozens of networks, Barab谩si said.
鈥淚n the real world, there is dirt and dust, and this dirt and dust will be on your data,鈥 said听听of Northeastern, another physicist-turned-network scientist. 鈥淵ou will never see the perfect power law.鈥
As an analogy, Barab谩si noted, a rock and a feather fall at very different speeds even though the law of gravitation says they should fall at the same speed. If you didn鈥檛 know about the effect of air resistance, he said, 鈥測ou would conclude that gravitation is wrong.鈥
Clauset doesn鈥檛 find this analogy convincing. 鈥淚 think it鈥檚 pretty common for physicists who are trained in statistical mechanics 鈥 to use these kinds of analogies for why their model shouldn鈥檛 be held to a very high standard.鈥
If you were to observe 1,000 falling objects instead of just a rock and a feather, Clauset said, a clear picture would emerge of how both gravity and air resistance work. But his and Broido鈥檚 analysis of nearly 1,000 networks has yielded no similar clarity. 鈥淚t is reasonable to believe a fundamental phenomenon would require less customized detective work鈥 than Barab谩si is calling for,听听on Twitter.
鈥淭he tacit and common assumption that all networks are scale-free and it鈥檚 up to us to figure out how to see them that way 鈥 that sounds like a nonfalsifiable hypothesis,鈥 he said.
If some of the networks rejected by the tests do involve a scale-free mechanism overlaid by other forces, then those forces must be quite strong, Clauset and Strogatz said. 鈥淐ontrary to what we see in the case of gravity 鈥 where the dominant effects really are dominant and the smaller effects really are small perturbations, it looks like what鈥檚 going on with networks is that there isn鈥檛 a single dominant effect,鈥 Strogatz said.
For Vespignani, the debate illustrates a gulf between the mindsets of physicists and statisticians, both of whom have valuable perspectives. Physicists are trying to be 鈥渢he artists of approximation,鈥 he said. 鈥淲hat we want to find is some organizing principle.鈥
The scale-free paradigm, Vespignani said, provides valuable intuition for how the broader class of heavy-tailed networks should behave. Many traits of scale-free networks, including their combination of robustness and vulnerability, are shared by heavy-tailed networks, he said, and so the important question is not whether a network is precisely scale-free but whether it has a heavy tail. 鈥淚 thought the community was agreeing on that,鈥 he said.
叠耻迟听, a network scientist at Microsoft Research in New York City,听听that this point of view 鈥渋s really shifting the goal posts.鈥 As with 鈥渟cale-freeness,鈥 he said, the term 鈥渉eavy-tailed鈥 is used in several different ways in the literature, and the two terms are sometimes conflated, making it hard to assess the various claims and evidence. The version of 鈥渉eavy-tailed鈥 that is close enough to 鈥渟cale-free鈥 for many properties to transfer over is not an especially broad class of networks, he said.
Scale-freeness 鈥渁ctually did mean something very clear once, and almost certainly that definition does not apply to very many things,鈥 Watts said. But instead of network scientists going back and retracting the early claims, he said, 鈥渢he claim just sort of slowly morphs to conform to all the evidence, while still maintaining its brand label surprise factor. That鈥檚 bad for science.鈥
Porter likes to joke that if people want to discuss something contentious, they should set aside U.S. politics and talk about power laws. But, he said, there鈥檚 a good reason these discussions are so fraught. 鈥淲e have these arguments because the problems are hard and interesting.鈥
Clauset sees his work with Broido not as an attack but as a call to action to network scientists, to examine a more diverse set of possible mechanisms and degree distributions than they have been doing. 鈥淧erhaps we should consider new ideas, as opposed to trying to force old ideas to fit,鈥 he said.
Vespignani agrees that there is work to be done. 鈥淚f you ask me, 鈥楧o you all agree what is the truth of the field?鈥 Well, there is no truth yet,鈥 he said. 鈥淭here is no general theory of networks.鈥