Category Archives: Uncategorized

Universal approximators vs. algorithmic completeness

Finally, it has dawned on me. A problem that I had troubles conceptualizing is the following. On the one hand, for the purposes of universal induction, it is necessary to search in an algorithmically complete space. This is currently not … Continue reading

Posted in Uncategorized | Leave a comment

My best paper

I have presented this paper in the AGI conference in New York this year. Some theorems on incremental compression It presents a general way of speeding up the search of short descriptions of data that is made up of features … Continue reading

Posted in Uncategorized | Leave a comment

The merits of indefinite regress

The whole field of machine learning, and artificial intelligence in general, is plagued by a particular problem: the well known curse of dimensionality. In a nutshell, this curse means that whenever we try to increase the dimension of our search … Continue reading

Posted in compression, Uncategorized | 7 Comments

Using features for the specialization of algorithms

A widespread sickness of present “narrow AI” approaches is the almost irresistible urge to set up rigid algorithms that find solutions in an as large as possible search space. This always leads to a narrow search space containing very complex … Continue reading

Posted in Uncategorized | Leave a comment

The physics of structure formation

The entropy in equilibrium thermodynamics is defined as , which always increases in closed systems. It is clearly a special case of Shannon entropy . If the probabilities are uniform, , then Shannon entropy boils down to thermodynamic entropy. A … Continue reading

Posted in Uncategorized | Leave a comment

Scientific progress and incremental compression

Why is scientific progress incremental? Clearly, the construction of increasingly unified theories in physics and elsewhere is an example incremental compression of experimental data, of the description of our world. On the other hand, we know that the compression problem, … Continue reading

Posted in Uncategorized | Leave a comment

Incremental compression

A problem of the incremental approach is obviously local minima in compression. Is it possible that the probability to end up in a local minimum decreases if the first compression step is large? It would be very cool, if that … Continue reading

Posted in Uncategorized | Leave a comment