JAWAHARLAL NEHRU TECHNOLOGICAL UNIVERSITY HYDERABAD

Prerequisite

Nil

Course Objectives:

• To understand the biological neural network and to model equivalent neuron models.
• To understand the architecture, learning algorithms
• To know the issues of various feed forward and feedback neural networks.
• To explore the Neuro dynamic models for various problems.

Course Outcomes

Upon completing this course, the student will be able to

• Understand the similarity of Biological networks and Neural networks
• Perform the training of neural networks using various learning rules.
• Understanding the concepts of forward and backward propagations.
• Understand and Construct the Hopfield models.

UNIT - I

Introduction: A Neural Network, Human Brain, Models of a Neuron, Neural Networks viewed as Directed Graphs, Network Architectures, Knowledge Representation, Artificial Intelligence and Neural Networks Learning Process: Error Correction Learning, Memory Based Learning, Hebbian Learning, Competitive, Boltzmann Learning, Credit Assignment Problem, Memory, Adaption, Statistical Nature of the Learning Process

UNIT - II

Single Layer Perceptrons: Adaptive Filtering Problem, Unconstrained Organization Techniques, Linear Least Square Filters, Least Mean Square Algorithm, Learning Curves, Learning Rate Annealing Techniques, Perceptron –Convergence Theorem, Relation Between Perceptron and Bayes Classifier for a Gaussian Environment Multilayer Perceptron: Back Propagation Algorithm XOR Problem, Heuristics, Output Representation and Decision Rule, Computer Experiment, Feature Detection

UNIT - III

Back Propagation: Back Propagation and Differentiation, Hessian Matrix, Generalization, Cross Validation, Network Pruning Techniques, Virtues and Limitations of Back Propagation Learning, Accelerated Convergence, Supervised Learning

UNIT - IV

Self-Organization Maps (SOM): Two Basic Feature Mapping Models, Self-Organization Map, SOM Algorithm, Properties of Feature Map, Computer Simulations, Learning Vector Quantization, Adaptive Patter Classification

UNIT - V

Neuro Dynamics: Dynamical Systems, Stability of Equilibrium States, Attractors, Neuro Dynamical Models, Manipulation of Attractors as a Recurrent Network Paradigm Hopfield Models – Hopfield Models, restricted boltzmen machine.

TEXT BOOKS:

• 1. Neural Networks a Comprehensive Foundations, Simon S Haykin, PHI Ed.,.
• 2. Introduction to Artificial Neural Systems Jacek M. Zurada, JAICO Publishing House Ed. 2006.

REFERENCE BOOKS:

• 1. Neural Networks in Computer Inteligance, Li Min Fu TMH 2003
• 2. Neural Networks -James A Freeman David M S Kapura Pearson Ed., 2004.
• 3. Artificial Neural Networks - B. Vegnanarayana Prentice Hall of India P Ltd 2005