Integration of a Distributed Hadoop System into the Infrastructure of a Technology Startup Company
Integration of a Distributed Hadoop System into the Infrastructure of a Technology Startup Company

Summary/Abstract: The article reviews the problems and methods of combining big data processing work in a fully distributed mode of operation into the infrastructure of a technology startup company. In this direction, the methods of integrating an external distributed Hadoop system (cluster) are described in more detail. These methods are connected to the operating scenarios for infrastructure integration. The problems with traffic and latency are reviewed. A plan of the process of implementation and operation of a distributed Hadoop system is presented with the steps and indicative term. The goal it reaches is a suitable system for operational work on projects in a technology startup company. Then, it is connected to a list of measures in the different stages in a startup company's work. The problems with operational management of the teamwork with flexible methodology and system administration are listed, discussed and solutions proposed.

• Details
• Contents