Gilpin, W. (2018). Cellular automata as convolutional neural networks. arXiv preprint arXiv:1809.02942.
Tried to predict cellular automata with deep networks (ReLU). Curious measure of entropy of activation patterns for almost-binary networks (just go through all possible inputs, look at the distribution of activation patterns, calculate H). But then at later layers entropy drops, and it drops faster if automata rules are simpler.
Tried to predict cellular automata with deep networks (ReLU). Curious measure of entropy of activation patterns for almost-binary networks (just go through all possible inputs, look at the distribution of activation patterns, calculate H). But then at later layers entropy drops, and it drops faster if automata rules are simpler.
