22.03.2013 Views

The Bak–Tang–Wiesenfeld „sandpile“ model (1987)

The Bak–Tang–Wiesenfeld „sandpile“ model (1987)

The Bak–Tang–Wiesenfeld „sandpile“ model (1987)

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

<strong>The</strong> <strong>Bak–Tang–Wiesenfeld</strong><br />

<strong>„sandpile“</strong> <strong>model</strong> (<strong>1987</strong>)<br />

• 2-D lattice of size L x L; every cell characterized by „slope“ z(x,y)<br />

= 0, 1, 2, ... ; x,y = 1,...,L<br />

• Force/grain of sand added at random location x,y:<br />

z(x, y) ← z(x, y)+1<br />

• If z(x,y) gets bigger than a critical value (usually 4), then site (x,y)<br />

topples and sand is distributed to 4 nearest neighbors:<br />

z(x, y) ← z(x, y) − 4<br />

z(x ± 1,y) ← z(x ± 1,y)+1<br />

z(x, y ± 1) ← z(x, y ± 1) + 1


Avalanches in the BTW<br />

<strong>„sandpile“</strong> <strong>model</strong><br />

Toppling of one site can lead to one or more neighboring sites<br />

toppling, whose neighbors may topple, etc.: avalanches.<br />

Question: what should happen at the boundary?<br />

- sand falls off the edge or<br />

- sand is conserved.<br />

An avalanche has a size (how many sites topple?) and a duration.<br />

What is the distribution of avalanche sizes and durations?


Self-Organized Critical Model<br />

Example:<br />

[Bak, Tang, Wiesenfeld, <strong>1987</strong><br />

15.04.2012 Viola Priesemann Neuronal Avalanches<br />

9


Bak, Tang, Wiesenfeld (<strong>1987</strong>)


Interestingly, the distributions of avalanche sizes and durations<br />

have power laws.<br />

p(s) ∝ s −αs , αs ≈ 5/4<br />

p(t) ∝ t −αt , αt ≈ 3/4<br />

In physical systems, such power laws are often associated with<br />

phase transisitons and occur only at finely tuned parameter<br />

settings of, e.g., the temperature. Here, the systems tunes itself<br />

to critical behavior. This is why this is called self-organized<br />

criticality (SOC).<br />

Similar power laws are observed in many different contexts ranging<br />

from the distributions of earth quakes over volcanic activities<br />

and brain activity to stock market crashes and many others.<br />

Some of these phenomena may also be instances of SOC.


P(x)<br />

P(x)<br />

P(x)<br />

P(x)<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 !4<br />

10 !5<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 !4<br />

10 !5<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 !4<br />

10 !5<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 0<br />

10 0<br />

10 0<br />

10 0<br />

10 2<br />

10 4<br />

(a)<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !4<br />

10 !3<br />

words proteins<br />

Internet<br />

10 2<br />

terrorism<br />

10 2<br />

10 2<br />

x<br />

10 4<br />

(d)<br />

(g)<br />

(j)<br />

10 4<br />

10 4<br />

10 6<br />

10 0<br />

10 !2<br />

10 !4<br />

10 !6<br />

10 0<br />

10 !2<br />

10 !4<br />

10 !6<br />

10 0<br />

10 !1<br />

10 !2<br />

10 0<br />

10 0<br />

10 2<br />

10 3<br />

10 4<br />

calls<br />

10 2<br />

10 4<br />

10 1<br />

HTTP<br />

10 5<br />

10 4<br />

10 6<br />

10 6<br />

(b)<br />

(e)<br />

(h)<br />

10 2<br />

10 6<br />

10 8<br />

10 7<br />

10 0<br />

10 !2<br />

10 !4<br />

10 0<br />

10 !1<br />

10 !2<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 0<br />

10 0<br />

10 0<br />

metabolic<br />

10 1<br />

wars<br />

10 1<br />

species<br />

10 !3<br />

10 !3<br />

birds blackouts book sales<br />

x<br />

(k)<br />

10 0<br />

10 !1<br />

10 !2<br />

10 6<br />

10 1<br />

x<br />

10 2<br />

10 2<br />

10 7<br />

(c)<br />

(f)<br />

(i)<br />

(l)<br />

10 3<br />

10 3<br />

10 2<br />

Power-law distributions in empirical data 25<br />

Clauset, Shalizi, Newman (2009). Power-law distributions in empirical data<br />

Fig. 6.1. <strong>The</strong> cumulative distribution functions P (x) and their maximum likelihood power-law Fig. 6.2. <strong>The</strong> cumulative distribution functions P (x) and their maximum likelihood power-law<br />

fits for the first twelve of our twenty-four empirical data sets. (a) <strong>The</strong> frequency of occurrence of fits for the second twelve of our twenty-four empirical data sets. (m) <strong>The</strong> populations of cities<br />

unique words in the novel Moby Dick by Herman Melville. (b) <strong>The</strong> degreedistributionofproteinsinin<br />

the United States. (n) <strong>The</strong> sizes of email address books at a university. (o) <strong>The</strong> number of<br />

the protein Power interaction network law of the yeast distributions S. cerevisiae. (c) <strong>The</strong> degree distribution are ofubiquitious. metabolitesacres<br />

burned in California But forest fires. there (p) <strong>The</strong> intensities could of solarbe flares. (q) <strong>The</strong> intensities of<br />

in the metabolic network of the bacterium E. coli. (d) <strong>The</strong> degree distribution of autonomous systems earthquakes. (r) <strong>The</strong> numbers of adherents of religious sects. (s) <strong>The</strong> frequencies of surnames in<br />

(groups of computers under single administrative control) on the Internet. (e) <strong>The</strong> number of callsthe<br />

United States. (t) <strong>The</strong> net worth in US dollars of the richest people in America. (u) <strong>The</strong><br />

received by many US customers different of the long-distance telephone mechanisms carrier AT&T. (f) <strong>The</strong> intensity responsible of warsnumbers<br />

of citations received for by published them academic - papers. not (v) just <strong>The</strong> numbers SOC.<br />

of papers authored<br />

from 1816–1980 measured as the number of battle deaths per 10 000 of the combined populations of by mathematicians. (w) <strong>The</strong> numbers of hits on web sites from AOL users. (x) <strong>The</strong> numbers of<br />

the warring nations. (g) <strong>The</strong> severity of terrorist attacks worldwide from February 1968 to Junehyperlinks<br />

to web sites.<br />

2006, measured by number of deaths. (h) <strong>The</strong> number of bytes of data received in response to HTTP<br />

(web) requests from computers at a large research laboratory. (i) <strong>The</strong> number of species per genus<br />

of mammals during the late Quaternary period. (j) <strong>The</strong> frequency of sightings of bird species in the the alternatives we tested using the likelihood ratio test, implying that these data sets<br />

United States. (k) <strong>The</strong> number of customers affected by electrical blackouts in the United States.<br />

(l) <strong>The</strong> sales volume of bestselling books in the United States.<br />

are not well-characterized by any of the functional forms considered here.)<br />

Tables 6.2 and 6.3 show the results of likelihood ratio tests comparing the best fit<br />

P(x)<br />

P(x)<br />

P(x)<br />

P(x)<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 !4<br />

10 !5<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 0<br />

10 2<br />

10 4<br />

10 6<br />

(m)<br />

10 !4<br />

10 !3<br />

10 !6<br />

cities email fires<br />

(p)<br />

10 8<br />

10 1 10 2 10 3 10 4 10 5 10 6<br />

10 !5<br />

10 !4<br />

flares<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 !4<br />

10 4<br />

10 !3<br />

10 !2<br />

10 !1<br />

10 0<br />

10 !4<br />

10 0<br />

10 !6<br />

10 !5<br />

surnames<br />

10 5<br />

authors<br />

10 1<br />

x<br />

10 2<br />

10 6<br />

(s)<br />

(v)<br />

10 3<br />

10 7<br />

10 0<br />

10 !1<br />

10 !2<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 !4<br />

10 !5<br />

10 0<br />

10 !1<br />

10 !2<br />

10 !3<br />

10 0<br />

10 0<br />

10 0<br />

10 8<br />

10 !5<br />

10 !4<br />

10 !3<br />

10 !2<br />

10 !1<br />

10 2<br />

10 1<br />

quakes<br />

10 9<br />

10 4<br />

wealth<br />

web hits<br />

10 2<br />

10 6<br />

10 10<br />

(n)<br />

(q)<br />

(t)<br />

10 3<br />

10 8<br />

10 11<br />

(w)<br />

10 0 10 1 10 2 10 3 10 4 10 5<br />

x<br />

10 !5<br />

10 !4<br />

10 !3<br />

10 !2<br />

10 !1<br />

10 0<br />

10 0<br />

10 !1<br />

10 !2<br />

10 0<br />

10 6<br />

10 0<br />

10 !6<br />

10 !5<br />

10 !4<br />

10 !3<br />

10 !2<br />

10 !1<br />

10 0<br />

10 0<br />

10 !2<br />

10 !4<br />

10 !6<br />

10 !8<br />

10 !10<br />

10 0<br />

10 1<br />

10 2<br />

religions<br />

10 7<br />

citations<br />

10 2<br />

10 2<br />

web links<br />

x<br />

10 4<br />

10 4<br />

10 8<br />

10 3<br />

(o)<br />

(r)<br />

(u)<br />

(x)<br />

10 6<br />

10 6<br />

10 9<br />

10 4


Branching Processes<br />

Following Grinstead & Snell, Introduction to Probability<br />

Simple statistical <strong>model</strong> with many applications in, e.g., population<br />

dynamics, propagation of activity in the nervous system, nuclear<br />

chain reactions, ...<br />

In sand pile <strong>model</strong>, one toppling site (parent) may induce toppling<br />

in other sites (children), which can induce further toppling in<br />

even more sites (grandchildren).<br />

Here: always start with one individual. This individual creates<br />

0,1,2,3,... offspring with probability: p0,p1,p2,p3,...<br />

In the next generation, each offspring independently has the same<br />

probabilities of creating their own offspring.


Here: always start with one individual. This individual has a certain<br />

probability of creating 0,1,2,3,... offspring. In the next generation,<br />

each offspring independently has the same probability of<br />

creating further offspring.<br />

378 CHAPTER 10. GENERATING FUNCTIONS<br />

Example:<br />

1/4<br />

1/4<br />

1/2<br />

2<br />

1<br />

0<br />

1/2<br />

1/16<br />

1/8<br />

5/16<br />

Figure 10.1: Tree diagram for Example 10.8.<br />

What is the probability of having a certain number of offspring<br />

in a certain generation? What is the probability of extinction?<br />

Branching processes have served not only as crude <strong>model</strong>s for population growth<br />

but also as <strong>model</strong>s for certain physical processes such as chemical and nuclear chain<br />

1/4<br />

1/4<br />

1/4<br />

1/4<br />

1/2<br />

4<br />

3<br />

2<br />

1<br />

0<br />

2<br />

1<br />

0<br />

1/64<br />

1/32<br />

5/64<br />

1/16<br />

1/16<br />

1/16<br />

1/16<br />

1/8


CHING PROCESSES 379<br />

Probability that process dies out by the mth generation:<br />

the probability that the process dies out by the mth generation. Of<br />

For the example calculate:<br />

0. In our example, d1 =1/2 and d2 =1/2+1/8+1/16 = 11/16 (see<br />

Note that:<br />

d0,d1,d2<br />

Note that we must add the probabilities for all paths that lead to 0<br />

eneration. It is clear from the definition that<br />

0=d0 ≤ d1 ≤ d2 ≤ ···≤ 1 .<br />

nverges to a limit d, 0≤ d ≤ 1, and d is the probability that the<br />

ltimately die out. It is this value that we wish to determine. We<br />

ressing the value dm in terms of all possible outcomes on the first<br />

f there Thus, are the jsequence offspringconverges in the first to generation, a value: 0 ≤then d ≤ 1to<br />

die out by the<br />

on, each of these lines must die out in m − 1 generations. Since they<br />

How can we calculate d?<br />

endently, this probability is (dm−1) j . <strong>The</strong>refore<br />

See blackboard.<br />

dm = p0 + p1dm−1 + p2(dm−1) 2 + p3(dm−1) 3 + ··· . (10.1)<br />

he ordinary generating function for the pi:<br />

dm


This leads us to the following theorem. ✷<br />

<strong>The</strong>orem 10.2 Consider a branching process with generating function h(z) for the<br />

number of offspring of a given parent. Let d be the smallest root of the equation<br />

z = h(z). If the mean number m of offspring produced by a single parent is ≤ 1,<br />

then d = 1 and the process dies out with probability 1. If m>1 then d

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!