Romanian Journal of Information Technology and Automatic Control
Signal Processing in Linear Neural Networks
Nicoleta Liviana Tudor
ltudor@upg-ploiesti.ro
Department of Information Technology. Mathematics, Physics, University Petrol & Gas of Ploieşti, Romania
Abstract: This paper addresses the problem of signal processing in neural network with linear units and includes an analysis of the representation of Boolean functions.
ADALINE (Adaptive Linear Neuron or later Adaptive Linear Element) is a single layer neural network. It was developed by Bernard Widrow and Ted Hoff at Stanford University in 1960. It is based on the McCulloch–Pitts neuron and consists of a weight, a bias and a summation function. The difference between Adaline and the standard perceptron (McCulloch-Pitts) is that in the learning phase the weights are adjusted according to the weighted sum of the inputs. There also exists an extension of linear neural network known as Madaline.
Learning is a process when free parameters (weights and bias levels) of a neural network are adapted and adjusted through a continuing process of stimulation by the environment in which the network is embedded.
Generic computing units are split into two functional parts: an integration function reduces the arguments to a single value and the output or activation function produces the output of this node taking that single value as its argument.
Keywords: signal processing, neural network, linear units, representation of Boolean functions.
REFERENCES:
- ANDERSON, JAMES: Neural models with cognitive implications. In LaBerge & Samuels, Basic Processes in Reading Perception and Comprehension Models. Hillsdale. Erlbaum, 1977, pp. 27-90.
- DUMITRESCU, HARITON COSTIN: Reţele neuronale. Teorie şi aplicaţii. Editura Teora, Bucureşti, 1996, 460 p.
- KRÖSE, BEN; PATRICK VAN DER SMAGT: An introduction to Neural Networks. University of Amsterdam. Netherlands, 1996, 135 p.
- MOISE, ADRIAN: Reţele neuronale pentru recunoaşterea formelor. Editura MATRIX ROM, Bucureşti, 2005, 309 p.
- MATLAB Online Help, version 7.1. 2005
- ROJAS, RAÚL: Neural Networks A Systematic Introduction. Springer-Verlag, Berlin, 199
- SCHALKOFF, ROBERT: Pattern Recognition Statistical. Structural and Neural Approaches. John Wiley & Sons, New York, 1992.
- WIDROW; STERNS:Adaptive Signal Processing. New York, Prentice-Hall, 1985.
- WIDROW; WINTER: Neural Nets for Adaptive Filtering and Adaptive Pattern Recognition. Computer 21, 1988, pp. 25-39.
- YU HEN HU; JENQ-NENG HWANG: Handbook of Neural Network Signal Processing. Electrical Engineering & Applied Signal Processing Series. CRC Press. 2001, 408 p.
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.