Scaling expansions:

universal tool for classification of complex systems

Jan Korbel, Rudolf Hanel and Stefan Thurner

  • Complex systems cover an enormous variety of systems (physics, chemistry, biology, sociology, economy...)         
    • Different systems have similar statistics 
    • No united classification 
  • However, statistical complex systems near the thermodynamic limit (\(N \rightarrow \infty \))   can be characterized by asymptotics of its sample space \(W(N)\)
  • Asymptotic behavior can be described by scaling expansion with coefficients corresponding to scaling exponents
  • Scaling exponents completely determine universality classes

 

Asymptotic behavior of \(W(N)\) for \(N \rightarrow \infty\) can be described by the    Poincaré asymptotic expansion

 

$$ f(W(N)) = \sum_{j=0}^n c_j \phi_{j}(N) + \mathcal{O}(\phi_n(N))$$

where \(f(W(N)) = \mathcal{O}(\phi_0(N)) \) and \(\phi_{j+1}(N) = \mathcal{O}(\phi_{j}(N)) \)

 

Question: What set of functions \( \phi_j(N) \)  describes scaling of \(W(N)\)?

                   Do the coefficients \( c_j \) have any connection to scaling?

Answer: Yes! 

                 We can define an expansion, where the coefficients

                 \(c_j\) are the scaling exponents of \(W(N)\)

 

Notation: \(f^{(n)}(x) = \underbrace{f(f(\dots(f(x))\dots))}_{n \ \mathrm{times}} \) 

 

Let us choose \(\phi_j(N) = \log^{(j+1)}(N)\), Then for some \(l\) we can write $$W^{(l)}(N) \equiv \log^{(l+1)}(W(x)) = \sum_{j=0}^n c_j^{(l)} \log^{(j+1)}(N) + \mathcal{O} (\phi_n (N))$$

 

The coefficients \(c_j^{(l)}\) are the scaling exponents of \(W\)!

We define the set of rescalings \(r_\lambda^{(n)}(x) := \exp^{(n)}(\lambda \log^{(n)}(x) \) )

So  \(r_\lambda^{(0)}(x) = \lambda x\),  \(r_\lambda^{(1)}(x) = x^\lambda\),   \(r_\lambda^{(2)}(x) =  e^{\log(x)^\lambda} \), ...

Properties: \(r_\lambda^{(n)} (r_{\lambda'}^{(n)}(x)) = r_{\lambda \lambda'}^{(n)}(x) \), \(r_1^{(n)}(x) = x\)


Leading order scaling: \( \lim_{N \rightarrow \infty}\frac{W^{(l)}(r_\lambda^{(0)}(N))}{W^{(l)}(N)} = \lambda^{\bf c_0^{(l)}} \)

First correction scaling: \( \lim_{N \rightarrow \infty} \frac{W^{(l)} (r_\lambda^{(1)}(N))}{W^{(l)}(N)} \left(\frac{r_\lambda^{(1)}(N)}{N}\right)^{-c_0^{(l)}} = \lambda^{\bf c_1^{(l)}}\)

General rescaling: \( \lim_{N \rightarrow \infty} \frac{W^{(l)}(r_\lambda^{(k)}(N))}{W^{(l)}(N)} \prod_{j=0}^{k-1} \left(\frac{\log^{(j)}(r_\lambda^{(k)}(N))}{\log^{(j)} N}\right)^{-c_j^{(l)}} = \lambda^{\bf c_k^{(l)}}\) 


Scaling expansion: \( W(N) \sim \exp^{(l)}\left(\prod_{j=0}^n (\log^{(j)}(N))^{c_j^{(l)}} \right)\)

J.K., R.H., S.T. New J. Phys. 20 093007

Examples

Random walk

  • Two possibilities:

step to the left/step to the right

  • For \(N\) steps we have

     \(W(N) = 2^N\)

     possible configurations (paths)

  • Scaling exponents:
    • ​\(l=1\)
    • \(c_0^{(1)}=1\)
    • \(c_k^{(1)}=0\) for \( k=1,2,\dots\)

Exponential growth:

Aging random walk

R.H., S.T. EPL 96 50003, Entropy 15 5324.

Sub-exponential growth (stretched exponential):

  •  RW with correlations
  • After 1 step,

      2 steps in the same direction,

      3 steps in the same direction....

  •  Asymptotically we get

      \(W(N) \approx 2^{\sqrt{N}/2} \sim 2^{N^{1/2}}\)                        

  • Scaling exponents:
    • ​\(l=1\)
    • \(c_0^{(1)}=1/2\)
    • \(c_k^{(1)}=0\) for \( k=1,2,\dots\)

Riemann random walk

Sub-exponential growth:

  •  another version of correlated RW
  •  The walker can make decision only for steps which are prime numbers
  •  Density of prime numbers:                

      \(\pi(N) \sim N/\log N\)

  •  \(W(N) = 2^{\pi(N)} \sim 2^{N/\log N}\)
  • Scaling exponents:
    • ​\(l=1\)
    • \(c_0^{(1)}=1\)
    • \(c_1^{(1)}=-1\)
    • \(c_k^{(1)}=0\) for \( k=2,3,\dots\)

Magnetic coins

 H. Jensen et al. J. Phys. A: Math. Theor. 51 375002

Super-exponential growth:

  • \(N\) coins - head or tail
  • Coins are magnetic - any two can stick together (1 state)
  •  \( W(N) \approx N^{N/2}  e^{2 \sqrt{N}} \sim e^{N \log N}\)  
  • Scaling exponents:
    • ​\(l=1\)
    • \(c_0^{(1)}=1\)
    • \(c_1^{(1)}=1\)
    • \(c_k^{(1)}=0\) for \( k=2,3,\dots\)

Random networks

Super-exponential growth (compressed exponential):

  • Undirected network with \(N\) nodes has \(\binom{N}{2}\) possible links
  • Number of possible networks \( W(N) = 2^{\binom{N}{2}} \sim 2^{N^2}\)  
  • Scaling exponents:
    • ​\(l=1\)
    • \(c_0^{(1)}=2\)
    • \(c_k^{(1)}=0\) for \( k=2,3,\dots\)

Random walk cascades

Super-exponential growth (double-exponential):

  • Generalization of RW
  • The walker can go to the left, to the right or split
  • After each split, there are two independent walkers
  • \(W(N) = 2^{2^N}-1 \sim 2^{2^N}\)                        
  • Scaling exponents:
    • ​\(l=2\)
    • \(c_0^{(2)}=1\)
    • \(c_k^{(2)}=0\) for \( k=1,2,\dots\)

Applications

Scaling expansions of extensive entropy

  • Scaling expansion can be also found for entropic functionals
  • This allows us to consistently define thermodynamics of complex systems and avoid paradoxes from BG thermodynamics
  • For microcanonical ensemble ( \(p_i = 1/W\) ) is the scaling expansion given by $$ S(W) \sim \prod_{j=0}^n (\log^{(l+j)} W)^{d_j^{(l)}}$$
  • Extensive entropy: \( S(W(N))  \sim N\) for \(N \rightarrow \infty\)
  • This gives us relation between \(c_k^{(l)} \) and \(d_k^{(l)} \): $$d_0^{(l)} = 1/c_0^{(l)}$$ $$d_k^{(l)} = - c_k^{(l)}/c_0^{(l)}$$

 

Process S(W)
Random walk 0 1 0    
Aging random walk 0 2 0
Riemann random walk 0 1 1
Magnetic coins 0 1 -1
Random networks 0 1/2 0
Random walk cascade 0 0 1

$$ S(W) \sim \prod_{j=0}^n (\log^{(j)} W)^{d_j}$$

Extensive entropy for example processes

\( \log W\)

\( (\log W)^2\)

\( (\log W)^{1/2}\)

\( \log \log W\)

\( \log W/\log \log W\)

\(d_0\)

\(d_1\)

\(d_2\)

\( \log W \cdot \log \log W\)

Scaling expansions of critical phenomena

  • Scaling expansions can determine critical exponents of systems near phase transitions
  • Let us have a critical point \(x_c\) where a relevant quantity \(F(x)\) diverges 
  • Let us write a scaling expansion of \( F \)

       in terms of \( \frac{1}{x-x_c} \)

$$ \log F(x) = \sum_{j=0}^n [\log^{(j+1)}(1/(x-x_c))]^{\alpha_j} + \mathcal{O}(\phi_n) $$

  • Therefore, we get $$ F(x) \propto (x-x_c)^{-\alpha_0} \log(1/(x-x_c))^{\alpha_1} \log \log(1/(x-x_c))^{\alpha_2}\dots $$
  • Typically, only leading-order term is considered, or some other expansions, which do not reflect higher-order rescalings

Information geometry of scaling expansions

  • Information geometry applies techniques of diffrerential geometry in statistics and probability theory
  • The central quantity of the IG is the information metric \(g_{ij}(p)\)
  • The metric is connected to Entropy \(S(P)\) trough Bregman divergence \(D(p||q) = S(p)-S(q) - \langle \nabla S(q),p-q\rangle \) as

 

  • Example:  information metric for the first two scaling exponents

\( g_{ij}(p) = \frac{\partial^2 D(p||q)}{\partial q_i \partial q_j}|_{p=q} \)

J.K., R.H., S.T. arXiv:1812.09893

Other possible applications:

  • Non-equilibrium thermodynamics
  • Dynamics of systems with structures
  • ...

We would like to discuss any possible applications, where

  • super-exponential processes
  • processes with structures
  • higher-order scaling exponents

might appear and play a role

Scaling expansions

By Jan Korbel

Scaling expansions

  • 115