STATISTICAL TESTS BASED ON ENTROPY ESTIMATES FOR CHECKING THE HYPOTHESES OF THE UNIFORM DISTRIBUTION OF A RANDOM SEQUENCE
Abstract
The actual information security problem of developing statistical tests of the hypothesis about a discrete uniform distribution (‘pure randomness’) of output sequences of cryptographic generators is considered. For the entropy functionals of Shannon, Renyi and Tsallis, the point statistical estimators based on the principle of ‘plug-in’ frequency statistics are constructed. The asymptotic probability distribution of the constructed point estimators is found when the ‘pure randomness’ hypothesis in asymptotics is valid, meaning that the number of observed data is comparable with the number of estimated parameters. With the use of the probability distributions of point estimators, the interval statistical estimators of considered information entropy functionals are constructed. On the basis of interval estimators, the decision rules for statistical testing of the hypothesis about the ‘pure randomness’ of the observed discrete sequence are developed. The results of computer experiments, in which the developed statistical tests are applied to the output sequence of cryptographic generators, are given. In these experiments, the output binary sequence was transformed to the sequence of alphabet with a larger dimension by combining the s neighboring elements in the s-grams.
About the Author
U. Yu. PalukhaBelarus
Postgraduate of the Department of Mathematical Modeling and Data Analysis, Faculty of Applied Mathematics and Computer Science, Belarusian State University; Junior Researcher of the Research Institute for Applied Problems of Mathematics and Informatics
References
1. Kharin Yu.S., Agievich S.V., Vasil’ev D.V., Matveev G.V. Cryptology. Minsk, Belarusian State University, 2013. 512 p. (In Russian).
2. Esteban M.D., Morales D.A summary on entropy statistics. Kybernetika, 1995, vol. 31, no. 4, pp. 337–346.
3. Bromiley P.A., Thacker N.A., Bouhova-Thacker E. Shannon Entropy, Renyi Entropy, and Information. Available at: http://www.tina-vision.net/docs/memos/2004-004.pdf. (accessed 8 April 2016).
4. Holst L. Asymptotic normality and efficiency for certain goodness-of-fit tests. Biometrika, 1972, vol. 59, no. 1, pp. 137–145. Doi: 10.2307/2334624
5. Kharin Yu.S., Zuev N.M., Zhuk E.E. Probability Theory, Mathematical and Applied Statistics. Minsk, Belarusian State University, 2011. 463 p. (In Russian).
6. Palukha V.Yu. The probability properties of the multivariate entropy estimator in information security tasks. XVII Respublikanskaya nauchno-prakticheskaya konferentsiya molodykh uchenykh. Sbornik materialov. Ch. 1 [Proceedings of XVII Republican Young Scientists Scientific and Practical Conference. Part 1]. Brest, Brest State University, 2015, pp. 57–59. (In Russian).
7. Palukha V.Yu., Kharin Yu.S. Entropy characteristics of binary sequences in cryptography. Kompleksnaya zashchita informatsii: materialy XX nauchno-prakticheskoi konferentsii [Complex Information Protection. Proceedings of XX Scientific and Practical Conference]. Minsk, Republican Institute for Higher Education, 2015, pp. 99–102. (In Russian).
8. Acharya J., Orlitsky A., Suresh A.T., Tyagi H. Estimating Renyi Entropy of Discrete Distributions. Available at http:// arxiv.org/pdf/1408.1000v3.pdf. (accessed 8 April 2016).
9. Envin A.Yu. Discrete Mathematics. Cheliabinsk, South Ural State University, 1998. 176 p. (In Russian).
10. Kharin Yu.S., Palukha U.Yu. Statistical estimates of Rényi and Tsallis entropy and their use for testing the ‘pure randomness hypotheses. Vestsі Natsyyanalnai akademіі navuk Belarusі. Seryya fіzіka-matematychnykh navuk [Proceedings of the National Academy of Sciences of Belarus. Physics and Mathematics Series], 2016, no. 2, pp. 37–47. (In Russian).
11. Speedtest-500MB.bin. Humboldt Berlin University, Faculty of Mathematics and Natural Sciences, Department of Physics. Available at http://qrng.physik.hu-berlin.de/files/speedtest-500MB.bin. (accessed 8 April 2016).