The Bak–Tang–Wiesenfeld „sandpile“ model (1987)
The Bak–Tang–Wiesenfeld „sandpile“ model (1987)
The Bak–Tang–Wiesenfeld „sandpile“ model (1987)
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>The</strong> <strong>Bak–Tang–Wiesenfeld</strong><br />
<strong>„sandpile“</strong> <strong>model</strong> (<strong>1987</strong>)<br />
• 2-D lattice of size L x L; every cell characterized by „slope“ z(x,y)<br />
= 0, 1, 2, ... ; x,y = 1,...,L<br />
• Force/grain of sand added at random location x,y:<br />
z(x, y) ← z(x, y)+1<br />
• If z(x,y) gets bigger than a critical value (usually 4), then site (x,y)<br />
topples and sand is distributed to 4 nearest neighbors:<br />
z(x, y) ← z(x, y) − 4<br />
z(x ± 1,y) ← z(x ± 1,y)+1<br />
z(x, y ± 1) ← z(x, y ± 1) + 1
Avalanches in the BTW<br />
<strong>„sandpile“</strong> <strong>model</strong><br />
Toppling of one site can lead to one or more neighboring sites<br />
toppling, whose neighbors may topple, etc.: avalanches.<br />
Question: what should happen at the boundary?<br />
- sand falls off the edge or<br />
- sand is conserved.<br />
An avalanche has a size (how many sites topple?) and a duration.<br />
What is the distribution of avalanche sizes and durations?
Self-Organized Critical Model<br />
Example:<br />
[Bak, Tang, Wiesenfeld, <strong>1987</strong><br />
15.04.2012 Viola Priesemann Neuronal Avalanches<br />
9
Bak, Tang, Wiesenfeld (<strong>1987</strong>)
Interestingly, the distributions of avalanche sizes and durations<br />
have power laws.<br />
p(s) ∝ s −αs , αs ≈ 5/4<br />
p(t) ∝ t −αt , αt ≈ 3/4<br />
In physical systems, such power laws are often associated with<br />
phase transisitons and occur only at finely tuned parameter<br />
settings of, e.g., the temperature. Here, the systems tunes itself<br />
to critical behavior. This is why this is called self-organized<br />
criticality (SOC).<br />
Similar power laws are observed in many different contexts ranging<br />
from the distributions of earth quakes over volcanic activities<br />
and brain activity to stock market crashes and many others.<br />
Some of these phenomena may also be instances of SOC.
P(x)<br />
P(x)<br />
P(x)<br />
P(x)<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 !4<br />
10 !5<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 !4<br />
10 !5<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 !4<br />
10 !5<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 0<br />
10 0<br />
10 0<br />
10 0<br />
10 2<br />
10 4<br />
(a)<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !4<br />
10 !3<br />
words proteins<br />
Internet<br />
10 2<br />
terrorism<br />
10 2<br />
10 2<br />
x<br />
10 4<br />
(d)<br />
(g)<br />
(j)<br />
10 4<br />
10 4<br />
10 6<br />
10 0<br />
10 !2<br />
10 !4<br />
10 !6<br />
10 0<br />
10 !2<br />
10 !4<br />
10 !6<br />
10 0<br />
10 !1<br />
10 !2<br />
10 0<br />
10 0<br />
10 2<br />
10 3<br />
10 4<br />
calls<br />
10 2<br />
10 4<br />
10 1<br />
HTTP<br />
10 5<br />
10 4<br />
10 6<br />
10 6<br />
(b)<br />
(e)<br />
(h)<br />
10 2<br />
10 6<br />
10 8<br />
10 7<br />
10 0<br />
10 !2<br />
10 !4<br />
10 0<br />
10 !1<br />
10 !2<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 0<br />
10 0<br />
10 0<br />
metabolic<br />
10 1<br />
wars<br />
10 1<br />
species<br />
10 !3<br />
10 !3<br />
birds blackouts book sales<br />
x<br />
(k)<br />
10 0<br />
10 !1<br />
10 !2<br />
10 6<br />
10 1<br />
x<br />
10 2<br />
10 2<br />
10 7<br />
(c)<br />
(f)<br />
(i)<br />
(l)<br />
10 3<br />
10 3<br />
10 2<br />
Power-law distributions in empirical data 25<br />
Clauset, Shalizi, Newman (2009). Power-law distributions in empirical data<br />
Fig. 6.1. <strong>The</strong> cumulative distribution functions P (x) and their maximum likelihood power-law Fig. 6.2. <strong>The</strong> cumulative distribution functions P (x) and their maximum likelihood power-law<br />
fits for the first twelve of our twenty-four empirical data sets. (a) <strong>The</strong> frequency of occurrence of fits for the second twelve of our twenty-four empirical data sets. (m) <strong>The</strong> populations of cities<br />
unique words in the novel Moby Dick by Herman Melville. (b) <strong>The</strong> degreedistributionofproteinsinin<br />
the United States. (n) <strong>The</strong> sizes of email address books at a university. (o) <strong>The</strong> number of<br />
the protein Power interaction network law of the yeast distributions S. cerevisiae. (c) <strong>The</strong> degree distribution are ofubiquitious. metabolitesacres<br />
burned in California But forest fires. there (p) <strong>The</strong> intensities could of solarbe flares. (q) <strong>The</strong> intensities of<br />
in the metabolic network of the bacterium E. coli. (d) <strong>The</strong> degree distribution of autonomous systems earthquakes. (r) <strong>The</strong> numbers of adherents of religious sects. (s) <strong>The</strong> frequencies of surnames in<br />
(groups of computers under single administrative control) on the Internet. (e) <strong>The</strong> number of callsthe<br />
United States. (t) <strong>The</strong> net worth in US dollars of the richest people in America. (u) <strong>The</strong><br />
received by many US customers different of the long-distance telephone mechanisms carrier AT&T. (f) <strong>The</strong> intensity responsible of warsnumbers<br />
of citations received for by published them academic - papers. not (v) just <strong>The</strong> numbers SOC.<br />
of papers authored<br />
from 1816–1980 measured as the number of battle deaths per 10 000 of the combined populations of by mathematicians. (w) <strong>The</strong> numbers of hits on web sites from AOL users. (x) <strong>The</strong> numbers of<br />
the warring nations. (g) <strong>The</strong> severity of terrorist attacks worldwide from February 1968 to Junehyperlinks<br />
to web sites.<br />
2006, measured by number of deaths. (h) <strong>The</strong> number of bytes of data received in response to HTTP<br />
(web) requests from computers at a large research laboratory. (i) <strong>The</strong> number of species per genus<br />
of mammals during the late Quaternary period. (j) <strong>The</strong> frequency of sightings of bird species in the the alternatives we tested using the likelihood ratio test, implying that these data sets<br />
United States. (k) <strong>The</strong> number of customers affected by electrical blackouts in the United States.<br />
(l) <strong>The</strong> sales volume of bestselling books in the United States.<br />
are not well-characterized by any of the functional forms considered here.)<br />
Tables 6.2 and 6.3 show the results of likelihood ratio tests comparing the best fit<br />
P(x)<br />
P(x)<br />
P(x)<br />
P(x)<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 !4<br />
10 !5<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 0<br />
10 2<br />
10 4<br />
10 6<br />
(m)<br />
10 !4<br />
10 !3<br />
10 !6<br />
cities email fires<br />
(p)<br />
10 8<br />
10 1 10 2 10 3 10 4 10 5 10 6<br />
10 !5<br />
10 !4<br />
flares<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 !4<br />
10 4<br />
10 !3<br />
10 !2<br />
10 !1<br />
10 0<br />
10 !4<br />
10 0<br />
10 !6<br />
10 !5<br />
surnames<br />
10 5<br />
authors<br />
10 1<br />
x<br />
10 2<br />
10 6<br />
(s)<br />
(v)<br />
10 3<br />
10 7<br />
10 0<br />
10 !1<br />
10 !2<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 !4<br />
10 !5<br />
10 0<br />
10 !1<br />
10 !2<br />
10 !3<br />
10 0<br />
10 0<br />
10 0<br />
10 8<br />
10 !5<br />
10 !4<br />
10 !3<br />
10 !2<br />
10 !1<br />
10 2<br />
10 1<br />
quakes<br />
10 9<br />
10 4<br />
wealth<br />
web hits<br />
10 2<br />
10 6<br />
10 10<br />
(n)<br />
(q)<br />
(t)<br />
10 3<br />
10 8<br />
10 11<br />
(w)<br />
10 0 10 1 10 2 10 3 10 4 10 5<br />
x<br />
10 !5<br />
10 !4<br />
10 !3<br />
10 !2<br />
10 !1<br />
10 0<br />
10 0<br />
10 !1<br />
10 !2<br />
10 0<br />
10 6<br />
10 0<br />
10 !6<br />
10 !5<br />
10 !4<br />
10 !3<br />
10 !2<br />
10 !1<br />
10 0<br />
10 0<br />
10 !2<br />
10 !4<br />
10 !6<br />
10 !8<br />
10 !10<br />
10 0<br />
10 1<br />
10 2<br />
religions<br />
10 7<br />
citations<br />
10 2<br />
10 2<br />
web links<br />
x<br />
10 4<br />
10 4<br />
10 8<br />
10 3<br />
(o)<br />
(r)<br />
(u)<br />
(x)<br />
10 6<br />
10 6<br />
10 9<br />
10 4
Branching Processes<br />
Following Grinstead & Snell, Introduction to Probability<br />
Simple statistical <strong>model</strong> with many applications in, e.g., population<br />
dynamics, propagation of activity in the nervous system, nuclear<br />
chain reactions, ...<br />
In sand pile <strong>model</strong>, one toppling site (parent) may induce toppling<br />
in other sites (children), which can induce further toppling in<br />
even more sites (grandchildren).<br />
Here: always start with one individual. This individual creates<br />
0,1,2,3,... offspring with probability: p0,p1,p2,p3,...<br />
In the next generation, each offspring independently has the same<br />
probabilities of creating their own offspring.
Here: always start with one individual. This individual has a certain<br />
probability of creating 0,1,2,3,... offspring. In the next generation,<br />
each offspring independently has the same probability of<br />
creating further offspring.<br />
378 CHAPTER 10. GENERATING FUNCTIONS<br />
Example:<br />
1/4<br />
1/4<br />
1/2<br />
2<br />
1<br />
0<br />
1/2<br />
1/16<br />
1/8<br />
5/16<br />
Figure 10.1: Tree diagram for Example 10.8.<br />
What is the probability of having a certain number of offspring<br />
in a certain generation? What is the probability of extinction?<br />
Branching processes have served not only as crude <strong>model</strong>s for population growth<br />
but also as <strong>model</strong>s for certain physical processes such as chemical and nuclear chain<br />
1/4<br />
1/4<br />
1/4<br />
1/4<br />
1/2<br />
4<br />
3<br />
2<br />
1<br />
0<br />
2<br />
1<br />
0<br />
1/64<br />
1/32<br />
5/64<br />
1/16<br />
1/16<br />
1/16<br />
1/16<br />
1/8
CHING PROCESSES 379<br />
Probability that process dies out by the mth generation:<br />
the probability that the process dies out by the mth generation. Of<br />
For the example calculate:<br />
0. In our example, d1 =1/2 and d2 =1/2+1/8+1/16 = 11/16 (see<br />
Note that:<br />
d0,d1,d2<br />
Note that we must add the probabilities for all paths that lead to 0<br />
eneration. It is clear from the definition that<br />
0=d0 ≤ d1 ≤ d2 ≤ ···≤ 1 .<br />
nverges to a limit d, 0≤ d ≤ 1, and d is the probability that the<br />
ltimately die out. It is this value that we wish to determine. We<br />
ressing the value dm in terms of all possible outcomes on the first<br />
f there Thus, are the jsequence offspringconverges in the first to generation, a value: 0 ≤then d ≤ 1to<br />
die out by the<br />
on, each of these lines must die out in m − 1 generations. Since they<br />
How can we calculate d?<br />
endently, this probability is (dm−1) j . <strong>The</strong>refore<br />
See blackboard.<br />
dm = p0 + p1dm−1 + p2(dm−1) 2 + p3(dm−1) 3 + ··· . (10.1)<br />
he ordinary generating function for the pi:<br />
dm
This leads us to the following theorem. ✷<br />
<strong>The</strong>orem 10.2 Consider a branching process with generating function h(z) for the<br />
number of offspring of a given parent. Let d be the smallest root of the equation<br />
z = h(z). If the mean number m of offspring produced by a single parent is ≤ 1,<br />
then d = 1 and the process dies out with probability 1. If m>1 then d