-
Archives
- March 2018
- February 2018
- August 2017
- July 2017
- March 2017
- October 2016
- September 2016
- July 2016
- December 2015
- July 2015
- June 2015
- May 2015
- January 2015
- September 2014
- May 2014
- February 2014
- December 2013
- October 2013
- September 2013
- August 2013
- July 2013
- February 2013
- January 2013
- December 2012
- September 2012
- August 2012
- July 2012
- June 2010
-
Meta
Author Archives: arthurfranz
A defense of strong atheism
This post is addressed at weak/agnostic atheists and makes an argument for strong atheism. If you believe in God, stop right here. The post will be useless to you, since you are probably not being rational about your beliefs anyway. … Continue reading
Posted in atheism
Leave a comment
Emergence of attention mechanisms during compression
It just dawned on me. When we want to compress, we have to do it in one or the other incremental fashion, arriving in description lengths of intermediate length during the process. Also, there will be different paths that we … Continue reading
Posted in attention, compression
Leave a comment
Hierarchical epsilon machine reconstruction
Having read this long paper by James P. Crutchfield (1994) “Calculi of emergence”, I have to admit, that it is very inspiring. Let’s think about the implications. The first achievement of the paper is the definition of statistical complexity. Note … Continue reading
Posted in Uncategorized
Leave a comment
Curious abstractions: how do we know that circles don’t have corners?
A simple but deep question. Why do we want to know this? In order to speed up compression we have mainly considered two ideas, exploiting the compositionality of functions that generate data (incremental compression) and exploiting power laws in natural … Continue reading
Posted in Uncategorized
Leave a comment
Universal approximators vs. algorithmic completeness
Finally, it has dawned on me. A problem that I had troubles conceptualizing is the following. On the one hand, for the purposes of universal induction, it is necessary to search in an algorithmically complete space. This is currently not … Continue reading
Posted in Uncategorized
1 Comment
My best paper
I have presented this paper in the AGI conference in New York this year. Some theorems on incremental compression It presents a general way of speeding up the search of short descriptions of data that is made up of features … Continue reading
Posted in Uncategorized
Leave a comment
The merits of indefinite regress
The whole field of machine learning, and artificial intelligence in general, is plagued by a particular problem: the well known curse of dimensionality. In a nutshell, this curse means that whenever we try to increase the dimension of our search … Continue reading
Posted in compression, Uncategorized
7 Comments
Using features for the specialization of algorithms
A widespread sickness of present “narrow AI” approaches is the almost irresistible urge to set up rigid algorithms that find solutions in an as large as possible search space. This always leads to a narrow search space containing very complex … Continue reading
Posted in Uncategorized
Leave a comment
The physics of structure formation
The entropy in equilibrium thermodynamics is defined as , which always increases in closed systems. It is clearly a special case of Shannon entropy . If the probabilities are uniform, , then Shannon entropy boils down to thermodynamic entropy. A … Continue reading
Posted in Uncategorized
Leave a comment
Scientific progress and incremental compression
Why is scientific progress incremental? Clearly, the construction of increasingly unified theories in physics and elsewhere is an example incremental compression of experimental data, of the description of our world. On the other hand, we know that the compression problem, … Continue reading
Posted in Uncategorized
Leave a comment