General purpose of this lecture is to explain on Neural Networks. A neural network can be defined as a model of reasoning based on the human brain. The brain consists of a densely interconnected set of nerve cells, or basic information-processing units, called neurons. Here also briefly discuss on Artificial Neural Networks, A Neuron Model, Binary threshold neurons and Sigmoid neurons. This lecture also present some theory of Neural Networks: Rosenblatt’s Perceptrons, Back-propagation Algorithm and Hopfield Network.