Statistical Recognition of a Set of Patterns Using Novel Probability Neural Network

详细信息    查看全文

• 作者：Andrey V. Savchenko (22)
  
• 关键词：Statistical pattern recognition ; sets of patterns ; probabilistic neural network ; hypothesis test for samples homogeneity
• 刊名：Lecture Notes in Computer Science
• 出版年：2012
• 出版时间：2012
• 年：2012
• 卷：7477
• 期：1
• 页码：104-114
• 全文大小：244KB
• 参考文献：1. Theodoridis, S., Koutroumbas, C.: Pattern Recognition, 4th edn. Elsevier Inc. (2009)
  2. Borovkov, A.A.: Mathematical Statistics. Gordon and Breach Science Publishers (1998)
  3. Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)
  4. Webb, A.R.: Statistical Pattern Recognition. Wiley, New York (2002) CrossRef
  5. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, New York (2001)
  6. Efromovich, S.: Nonparametric Curve Estimation. Methods, Theory and Applications. Springer, New York (1999)
  7. Murthy, V.K.: Estimation of probability density. Annals of Mathematical Statistics?36, 1027-031 (1965) CrossRef
  8. Parzen, E.: On estimation of a probability density function and mode. Annals of Mathematical Statistics?33, 1065-076 (1962) CrossRef
  9. Greblicki, W.: Asymptotically optimal pattern recognition procedures with density estimates. IEEE Transactions on Information Theory?IT-24, 250-51 (1978) CrossRef
  10. Wolverton, C.T., Wagner, T.J.: Asymptotically optimal discriminant functions for pattern classification. IEEE Transactions on Information Theory?15, 258-65 (1969) CrossRef
  11. Specht, D.F.: Probabilistic neural networks. Neural Networks?3, 109-18 (1990) CrossRef
  12. Specht, D.F.: Probabilistic Neural Networks for Classification, Mapping, or Associative Memory. In: IEEE International Conference on Neural Networks, vol.?I, pp. 525-32 (1988)
  13. Specht, D.F.: A general regression neural network. IEEE Transactions on Neural Networks?2(6), 568-76 (1991) CrossRef
  14. Rutkowski, L.: Adaptive Probabilistic Neural Networks for Pattern Classification in Time-Varying Environment. IEEE Transactions on Neural Networks?15(4), 811-27 (2004) CrossRef
  15. Kullback, S.: Information Theory and Statistics. Dover Pub. (1997)
  16. Jones, M.C., Marron, J.S., Sheather, S.J.: A brief survey of bandwidh selection for density estimation. Journal of the American Statistical Association?91, 401-07 (1996) CrossRef
  17. Kukushkina, O.V., Polikarpov, A.A., Khmelev, D.V.: Using Literal and Grammatical Statistics for Authorship Attribution. Problems of Information Transmission?37(2), 172-84 (2001) CrossRef
  18. The e-library of Maxim Moshkov, http://www.lib.ru
  19. Savchenko, A.V.: Image Recognition with a Large Database Using Method of Directed Enumeration Alternatives Modification. In: Kuznetsov, S.O., ?l?zak, D., Hepting, D.H., Mirkin, B.G. (eds.) RSFDGrC 2011. LNCS (LNAI), vol.?6743, pp. 338-41. Springer, Heidelberg (2011) CrossRef
  20. Savchenko, A.V.: Directed enumeration method in image recognition. Pattern Recognition?45(8), 2952-961 (2012) CrossRef
  21. Aizerman, M.A., Braverman, E.M., Rozonoer, L.I.: Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control?25, 821-37 (1964)
  22. Stamatatos, E.: A survey of modern authorship attribution methods. Journal of the American Society for Information Science and Technology?60(3), 538-56 (2009) CrossRef
  23. Mao, K.Z., Tan, K.-C., Ser, W.: Probabilistic neural-network structure determination for pattern classification. IEEE Transactions on Neural Networks?11, 1009-016 (2000) CrossRef
  
• 作者单位：Andrey V. Savchenko (22)
  
  22. National Research University Higher School of Economics, Nizhniy Novgorod, Russian Federation
  

文摘

Since the works by Specht, the probabilistic neural networks (PNNs) have attracted researchers due to their ability to increase training speed and their equivalence to the optimal Bayesian decision of classification task. However, it is known that the PNN’s conventional implementation is not optimal in statistical recognition of a set of patterns. In this article we present the novel modification of the PNN and prove that it is optimal in this task with general assumptions of the Bayes classifier. The modification is based on a reduction of recognition task to homogeneity testing problem. In the experiment we examine a problem of authorship attribution of Russian texts. Our results support the statement that the proposed network provides better accuracy and is much more resistant to change the smoothing parameter of Gaussian kernel function in comparison with the original PNN.