Scalable sandbox environments for a modern organization
Автор: Topchyan Artyom
Журнал: Труды Института системного программирования РАН @trudy-isp-ran
Статья в выпуске: 4 т.28, 2016 года.
Бесплатный доступ
With the growing volume and demand for data, a major concern for an Organization is the creation of collaborative Data-Driven projects. With the amount of data, number of departments and the development of potential use cases, the complexity of creating Multitenant and Collaborative environments for multidisciplinary teams to work and create productive solutions, is becoming more and more important problem. In this work, we describe an approach to building such an environment with scalability, flexibility and productivity in mind. This solution is an integral part of a joint Operational Data Platform for data exploration and processing at large data driven Organizations.
Data-driven projects, distributed, multidisciplinary, sandbox, auto-scaling, collaboration, fault-tolerance, isolation, containers, mesos, microservices
Короткий адрес: https://sciup.org/14916374
IDR: 14916374 | DOI: 10.15514/ISPRAS-2016-28(4)-2
Список литературы Scalable sandbox environments for a modern organization
- Topchyan A.R. Enabling Data Driven Projects for a Modern Enterprise. Trudy ISP RAN/Proc. ISP RAS, vol. 28, issue 3, 2016, pp. 209-230 DOI: 10.15514/ISPRAS-2016-28(3)-13
- Topchyan A.R. Information Retrieval and Analysis for a Modern Organization. Trudy ISP RAN/Proc. ISP RAS, vol. 28, issue 4, 2016, pp. 7-28 DOI: 10.15514/ISPRAS-2016-28(4)-1
- Rahman, Nayem, and Fahad Aldhaban. "Assessing the effectiveness of big data initiatives."2015 Portland International Conference on Management of Engineering and Technology (PICMET). IEEE, 2015.
- Davenport, Thomas H., and Jill Dych´e. "Big data in big companies."International Institute for Analytics (2013).
- Shearer C. The CRISP-DM model: the new blueprint for data mining. J Data Warehousing; 5:13-22, 2000
- Tom White. Hadoop: The definitive guide. O’Reilly Media 2012
- Rowstron, Antony, et al. "Nobody ever got fired for using Hadoop on a cluster. “Proceedings of the 1st International Workshop on Hot Topics in Cloud Data Processing. ACM, 2012.
- Lin, Chia-Feng, et al. "The study and methods for cloud based CDN."CyberEnabled Distributed Computing and Knowledge Discovery (CyberC), 2011 International Conference on. IEEE, 2011.
- Alex Gorelik. The Enterprise Big Data Lake: Delivering on the Promise of Hadoop and Data Science in the Enterprise. O’Reilly Media 2016
- Shen, Zhiming, et al. "Cloudscale: elastic resource scaling for multi-tenant cloud systems. “Proceedings of the 2nd ACM Symposium on Cloud Computing. ACM, 2011.
- Li, Peng, Lee Toderick, and Joshua Noles. "Provisioning virtualized datacenters through virtual computing lab."2010 IEEE Frontiers in Education Conference (FIE). IEEE, 2010.
- Rami Rosen. "Resource management: Linux kernel namespaces and cgroups"(PDF). cs.ucsb.edu. Retrieved February 11, 2015.
- Apache Mesos. http://mesos.apache.org, 2015.
- Verma, Abhishek, et al. "Large-scale cluster management at Google with Borg."Proceedings of the Tenth European Conference on Computer Systems. ACM, 2015.
- Burns, Brendan, and David Oppenheimer. "Design Patterns for Containerbased Distributed Systems."8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 16), 2016.
- Burns, Brendan, et al. Borg, Omega, and Kubernetes."Communications of the ACM 59.5: 50-57, 2016.
- Koutsonikola, Vassiliki, and Athena Vakali. "LDAP: framework, practices, and trends."IEEE Internet Computing 8.5: 66-72, 2004
- Project Calico. https://www.projectcalico.org 2015.
- Jain, Raj, and Subharthi Paul. "Network virtualization and software defined networking for cloud computing: a survey." IEEE Communications Magazine 51.11: 24-31, 2013
- JAMES, BD. "Isolating network traffic in multi-tenant virtualization environments."U.S. Patent No. 7,885,276. 8 Feb, 2011.
- Otte, Stefan. "Version Control Systems."Computer Systems and Telematics, 2009.
- FraunhoferFS "FraunhoferFS High-Performance Parallel File System “Computer Systems and Telematics, 2009.
- Klaver, Jeroen; van der Jagt, Roel. Distributed file system on the SURFnet network Report, University of Amsterdam System and Network Engineering, 2010
- Newman, Sam. Building Microservices. "O’Reilly Media, Inc.", 2015.
- Marathon. https://mesosphere.github.io/marathon, 2015.
