Comparative study of the algorithms of design of recommendation systems based on the analysis of big data on consumer baskets
Автор: Olyanich I.A., Serafimovich P.G.
Журнал: Онтология проектирования @ontology-of-designing
Рубрика: Методы и технологии принятия решений
Статья в выпуске: 4 (30) т.8, 2018 года.
Бесплатный доступ
The article describes the algorithms for building recommender systems based on the analysis of data on grocery purchases of users of one of the largest online retailers. Using modern methods of data storage and analysis, effective recommender systems allow, in particular, to form the customers' interest and to increase the value of the average bill in individual orders. The article describes a built-in hardware and software system on Amazon cloud web services. Using this system, the initial data set was studied, typical examples of recommendations were constructed and the ALS and SVD algorithms were compared. We considered the use of frameworks Apache Hadoop and Apache Spark for the analysis of large format data on consumer baskets. The article analyzes the peak days of the week and workload during the day. Found popular product categories. We studied the demand for various groups of goods by day of the week and the frequency of purchases. The dependencies between the first and subsequent orders, popular products for the first and subsequent orders, and also changes in customer preferences over time were identified.
Hadoop, spark, design of recommendation systems, apache, collaborative filtering, matrix factorization, alternating least squares, singular-value decomposition
Короткий адрес: https://sciup.org/170178806
IDR: 170178806 | DOI: 10.18287/2223-9537-2018-8-4-628-640