Mutual information in a dilute, asymmetric neural network model.

Neural networks with asymmetric synaptic connections (w(ij) not equal to w(ji)) display a broad range of dynamical behavior including fixed point, periodic, and "chaotic" trajectories. Previous work has shown that such networks undergo an order-chaos phase transition as various network parameters, such as the connectivity or the degree of asymmetry, are changed. Here, using an information theoretic approach, we present results which suggest that neurons are able to communicate information to each other most effectively in networks that are near the order-chaos transition. We then extend the model to incorporate some biologically relevant features.