Analyzing Network Robustness in Scale-Free Networks: Exponential & Scale-Free, Study notes of Mechanical Engineering

The concept of network robustness in the context of exponential and scale-free networks. The properties of these networks, including their degree distribution, fractal structures, and robustness to random failure and targeted attacks. The document also includes visualizations of network structures and simulations of preferential attachment models. Useful for students studying network science, computer science, or related fields.

Typology: Study notes

Pre 2010

Uploaded on 07/30/2009

koofers-user-qok-1
koofers-user-qok-1 🇺🇸

5

(1)

10 documents

1 / 21

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
MAE 298, Lecture 4
Jan. 16, 2008
We are living in a connected world.
Networks permeate every aspect of
our lives. Our consciousness is based
on the network of neurons in our brain. Our
society is formed by various social, economi-
cal and political networks. The Internet,
which is profoundly changing the way we
live, is nothing but a network of information
resources. Our overall well-being depends to
a large extent on the stability and health of
many networks. Yet we live in a constantly
changing and often hostile environment. It
is therefore important to understand how
robustly these networks respond to disrup-
tions. On page 378 of this issue, Albert, Jeong
and Barabási1address this problem in a
simple and elegant way. They find that the
tolerance of networks to different types of
perturbation depends critically on the net-
work structure.
Given a set of nodes and links, a simple
network can be built by linking pairs of
nodes at random until we use up all the
available links2. Such a random network
belongs to the class of exponential net-
works because each node has roughly the
same number of connections (it is statis-
tically homogeneous) and the frequency
of highly connected nodes decreases expo-
nentially. But most naturally occurring
networks have much more intricate hierar-
chical structures; for example, the frequency
of highly connected nodes often decays as a
simple power law. Power laws are found in
many areas, from the distribution of popu-
lation sizes to the frequency of scientific
citations. Networks that follow power laws
are called scale-free networks because they
are not tied to a specific scale. This means
they are extremely inhomogeneous: where-
as most nodes have one or two links, a few
highly connected nodes will have a large
number of links and so play a key role in the
behaviour of the network.
Albert and co-workers1wisely simplify
their study of network tolerance by focusing
on these two classes of network structure: the
random, exponential network and the self-
organized, scale-free network. To measure
the quantitative performance of a network,
the authors use the average distance between
two nodes in the network, where distance is
defined by the minimum number of links
between these two nodes. The authors also
consider two types of destructive perturba-
tion: randomly occurring error, which is due
to random malfunction of the nodes; and
an intentional attack, which is aimed at the
most connected nodes.
For an exponential network, Albert and
co-workers find that the accumulation of
random errors has a deteriorating effect on
the network performance. This decrease in
network performance occurs because each
deletion of a node destroys some local
paths, which leads to an increase in the dis-
tance between the nodes involved in these
paths. The above argument seems quite
reasonable and general. But in the case of a
scale-free network, Albert and co-workers
make a surprising discovery: they find that
the performance of the scale-free network
is almost unchanged by the random removal
of nodes up to a large deletion rate.
The immunity of this networks perfor-
mance to random error suggests two features
about the network structure: first, most of
the nodes are just end users, the removal
of which does not affect the paths between
other nodes; second, there are degenerate
paths between nodes, which implies the
existence of highly connected nodes. These
two competing requirements have apparent-
ly found the perfect balance in the scale-free
network. Further study is needed to under-
stand this networks immunity to random
error one can only speculate that the
reason lies deep in the scale-free nature of
the network structure.
However, the structure that makes the
scale-free network superior to the exponen-
tial network in the case of random error
becomes its Achilles heel under hostile
attack. The most effective way of destroying
a network is to attack its most connected
nodes. For the scale-free network, in which
there are nodes of high connectivity, the
effect of targeted attack is much more severe
NATURE
|
VOL 406
|
27 JULY 2000
|
www.nature.com 353
news and views
How robust is the Internet?
Yuhai Tu
Figure 1 What does the Internet look like? No map exists of the entire Internet, but these lines show
the paths an e-mail might take across some of the largest networks. The lines branch at each network
router, or node, along the way. Colours were assigned according to the geographic domain (for
example, .se for Sweden) where each network router was registered. The map was created using the
skitter tool (developed by D. McRobb at CAIDA)7, which sends out small packets of data from a
source to many destinations through the Internet. The data collected by skitter give a snapshot of
the Internet at a particular moment. (Graph created by B. Huffaker using graph layout code provided
by B. Cheswick and H. Burch.)
CAIDA
Switzerland
Germany
Spain
Italy
Japan
Netherlands
Russian
Federation
Sweden
UK
USA
Unknown
Complex systems, such as the Internet, are surprisingly resistant to random
errors. But a new study warns against complacency the feature that
makes the Internet immune to accidents also makes it vulnerable to attack.
© 2000 Macmillan Magazines Ltd
“Exploring network robustness”
pf3
pf4
pf5
pf8
pf9
pfa
pfd
pfe
pff
pf12
pf13
pf14
pf15

Partial preview of the text

Download Analyzing Network Robustness in Scale-Free Networks: Exponential & Scale-Free and more Study notes Mechanical Engineering in PDF only on Docsity!

MAE 298, Lecture 4

Jan. 16, 2008

n a connected world. meate every aspect of consciousness is based rons in our brain. Our ar twiousorks. social, The ecInonomi-ternet, changing the way we etwork of information l well-being depends to stability and health of we live in a constantly ostile environment. It nt to understand how rks respond to disrup- this issue, Albert, Jeong ss this problem in a s^ a yt.o^ The diffye^ rfindent tthatype^ sthe of s critically on the net- des and links, a simple lt by linking pairs of ntil we use up all the h a random network of ‘exponential net- node has roughly the nnections (it is statis- s) and the frequency no ndaetsu draelclyre aoscecs (^) uerxrpinog- more intricate hierar- Figure 1 What does the Internet look like? No map exists of the entire Internet, but these lines show the paths an e-mail might take across some of the largest networks. The lines branch at each network r example, .se for Souter, or node, along the waweden) whery.e eac Colours wh netweorrek r assigoutned acer was rcoergding tistered. The map was cro the geographic domain (foreated using the skitter tool (developed by D. McRobb at CAIDA)^7 , which sends out small packets of data from a CAID A Switzerland Germany Spain Italy Japan Netherlands Russian Federation Sweden UK USA Unknown stems, such as the Internet, are surprisingly resistant to random new study warns against complacency — the feature that nternet immune to accidents also makes it vulnerable to attack.

“Exploring network robustness”

Power laws, pk ∼ k−γ ln pk ∼ −γ ln k

1e−10 1 100 10000

1e−

1e−

1e−

k

p(k)

As probability distributions:

  • For 1 < γ ≤ 2 , both the average 〈k〉 and σ^2 =

〈 k^2

〉 − 〈k〉^2 diverge.

  • For 2 < γ ≤ 3 , average 〈k〉 is finite, but σ^2 diverges.
  • For γ > 3 , both average and standard deviation finite.

Self-similar/scale-free fractal structures

Sierpinski Sieve/Gasket/Fractal, N ∼ rd. When r doubles, N triples: 3 = 2d

d = log N/ log r = log 3/ log 2

“Fractal dimension” of a network

http://en.wikipedia.org/wiki/Fractal dimension on networks

Rate equations (Let nk,t ≡ number of nodes of degree k at time t , and nt ≡ total number of nodes at time t : Note nt = t )

For each arriving link:

  • For k > m : nk,t+1 = nk,t + (k 2 −mt1) nk− 1 ,t − (^2) mtk nk,t
  • For k = m : nm,t+1 = nm,t + 1 − 2 mmt nm,t

But each arriving node contributes m links:

  • For k > m : nk,t+1 = nk,t + m( 2 kmt−1) nk− 1 ,t − 2 mkmnt nk,t
  • For k = m : nm,t+1 = nm,t + 1 − m

2 2 mt nm,t

Recursion for pm

pk =

(k−1)(k−2)···(m)

(k+2)(k+1)···(m+3) ·^ pm^ =^

m(m+1)(m+2)

(k+2)(k+1)k ·^

(m+1)

pk =

2 m(m+1) (k+2)(k+1)k

For k  1

pk ∼ k−^3

Get only γ = 3 power laws.

The Internet?

  • Michalis Faloutsos, Petros Faloutsos, Christos Faloutsos, “On power-law relationships of the Internet topology”, ACM SIGCOMM Computer Communication Review Volume 29 , Issue 4 Oct. 1999.
  • γ ≈ 2. 1
  • (over 1300 cites)

1

10

100

1000

10000

1 10 100

exp(7.68585) * x ** ( -2.15632 )^ "971108.out"

1

10

100

1000

10000

1

Robustness of “scale-free” graphs

Reka Albert, Hawoong Jeong and Albert-Laszlo Barabasi, “Error and attack tolerance of complex networks”, Nature, 406 (27) 2000. (Correction: 409 2001).

“The Achilles Heel of the Internet”

  • “How robust is the Internet?” Yuhai Tu, Nature (New and Views) 406 (27) 2000.
  • “Scientists spot Achilles heel of the Internet”, CNN, July 26,

Exponential vs scale-free: Robustness istribution P ( k ), is connected to k terized by a P ( k ) ly for large k. The networks are the the small-world rly homogeneous he same number orld-Wide Web orks^17 –^19 indicate eneous networks, s as a power-law, hereas the prob- ections ( k q 〈 k 〉) highly connected orks (Fig. 1). e two basic con- R) model9,10^ that nd the scale-free first define the N robability p. This g. 1), whose con- 〈 k 〉 and decaying the diameter of the WWW, with over 800 million nodes^20 , is around 19 (ref. 3), whereas social networks with over six billion individuals 15 20 5 10 15 0.00^4 0.02 0. 6 8 10 (^12) a b c d Internet WWW Attack Failure Attack Failure E SF Attack Failure

  • (Remember, bigger diameter is worse.)
  • SF are extremely robust to random failure (blue squares). Remove fraction

of nodes at random, and no change in diameter.

  • SF are very fragile to targeted attack (removal of highest degree nodes).

hly connected ks (Fig. 1). wo basic con- model9,10^ that the scale-free st define the N ability p. This ), whose con- 〉 and decaying e-free and a scale-free ave approximately (^10) 0.00 0.01 0. 15 20 0.00^0 0.01 0. 5 10 15 0.00^4 0.02 0. b c f d Internet WWW Attack Failure Attack Failure Figure 2 Changes in the diameter d of the network as a function of the fraction f of the removed nodes. a , Comparison between the exponential (E) and scale-free (SF) network models, each containing N ¼ 10 ; 000 nodes and 20,000 links (that is, 〈 k 〉 ¼ 4). The blue symbols correspond to the diameter of the exponential (triangles) and the scale-free (squares) networks when a fraction f of the nodes are removed randomly (error tolerance). Red symbols show the response of the exponential (diamonds) and the scale-free (circles) networks to attacks, when the most connected nodes are removed. We determined the f dependence of the diameter for different system sizes ( N ¼ 1 ;000; 5,000; 20,000) and found that the obtained curves, apart from a logarithmic size correction, overlap with those shown in a , indicating that the results are independent of the size of the system. We

  • Used the topological map of the Internet, containing 6,209 nodes and

12,200 links < k >= 3. 4 ), collected by the National Laboratory for Applied Network Research http://moat.nlanr.net/Routing/rawdata/

  • World-Wide Web data measured on a sample containing 325,729 nodes

and 1,498,353 links, such that < k >= 4. 59.

The ’robust yet fragile’ nature of the Internet

John C. Doyle, David L. Alderson, Lun Li, Steven Low, Matthew Roughan, Stanislav Shalunov, Reiko Tanaka, and Walter Willinger, PNAS (2005) vol. 102 no. 41 1449714502.

Fig. the (^) same 1. Diversity graph, but among the figure graphs on having the right the is redrawnsame degree to emphasize sequence the D. (role a ) RNDnet: that high-degree a network hubs consistent play in (^) overallwith construction network connectivity. by PA. The (two b ) SFnet: networks a graph represent having the nodes. most ( c (^) )preferential BADNet: a poorly connectivity, designed again network drawn with both overall as an connectivityincremental constructedgrowth type from of network a chain and of vertices. in a form ( d that) HOTnet: emphasizes a graph the constructed importance to of be high-deg a simplifiedree

“Scale-free”??

  • Power law degree distribution → “scale-free” degree distribution.
  • But does that mean there are no scales at all in the system?
  • Real-world data is high-dimensional.
  • “Scale-free” in one attribute DOES NOT mean scale-free in all attributes.
  • Doyle et al, “scale-rich” networks.

Power law degree dist DOES NOT imply scale-free in all attributes!!

Simulating PA

Basic code for simulating PA with m = 1 using R:

  • runPA ← function(N=100) { # outLink[i] is the parent of i outLink ← numeric(N) # numlinks[i] is number total-links (in and out) for node i numLinks ← numeric(N)+ for(i in 2:N) { p ← sample(c(1:(i-1)),size=1,prob=numLinks[1:(i-1)]) outLink[i] ← p numLinks[p] ← numLinks[p]+ } return(list(outLink, numLinks)) }
  • Visualizing a PA graph ( m = 1 ) at n =