Artificial neural networks are complex networks emulating the manner human rational neurons process data. They have been widely used in prediction, clustering, classification, and association. The training algorithms that determine the network weights are almost the most important factor that influences the neural network¿s performance. Lately several meta-heuristic and Evolutionary algorithms are employed to optimize neural networks weights to realize higher neural performance.To solve complex computational problems many meta-heuristic optimization algorithms have been developed. A meta-heuristic is a higher-level procedure designed to discover, create, or select a heuristic that may provide a sufficiently good solution to an optimization problem, especially with incomplete or imperfect information or limited computation capacity. Meta-heuristics may make limited assumptions about the optimization problem being solved, and so they may be usable for a variety of problems. Many meta-heuristics implement some form of stochastic optimization so that the solution found is dependent on the set of random variables generated.