The most used artificial neural networks have a monolithic structure. A lot of the models work on fully connected networks or layers (Hopfield or multilayer Perceptron). These networks perform well on a very small input space. However the complexity increases and the performance decreases rapidly with a growing input dimension [koho88]. The next paragraph gives a motivation for modular ANN.