Vstříc decentralizovanému peer-to-peer clusteru

Abstract

The Clondike - CLuster Of Non-Dedicated Interoperating KErnels - is a long term research project of a non-dedicated cluster architecture at the Faculty of Information Technology of CTU in Prague. The thesis deals with its conversion into a Peer-to-peer (P2P) scalable cluster where single nodes can share their computing resources between each other. P2P design oers many benets over a single-master or a multi-master architecture in terms of scalability, reliability and independence. On top of that every participating node can use computing resources of other nodes as well. None of the analyzed existing clusters provides the same functions as we implement to Clondike. Clondike operates on the kernel level thus unmodied system processes can be migrated. Eciency of this universal approach is comparative to task-specic application frameworks what we verify on a set of measurements on dierent types of clusters. An important component of every distributed system is a protocol that connects new nodes and keeps communication between the existing ones. We present an algorithm inspired by protocols used in P2P le-sharing networks. This algorithm reaches a logarithmic scalability and allows Clondike to scale as a global cluster. Clondike is an open source project so we assume that there will be modied Clondike clients that will try to exploit resources of other nodes. We introduce a service blockchain network for o-chain Clondike computations. This network is used to log and verify all transactions so a reputation of each node can be evaluated and unfair nodes can be eliminated. This thesis presents a working version of the proposed Clondike cluster. In particular, the main contributions of the dissertation thesis are as follows: 1. Evaluation of existing peer-to-peer Clondike cluster in laboratory and real-world environments. 2. Introduction of a scalable peer-to-peer inter-node communication and bootstraping protocol. 3. Introduction of a blockchain service network for o-chain computations.The Clondike - CLuster Of Non-Dedicated Interoperating KErnels - is a long term research project of a non-dedicated cluster architecture at the Faculty of Information Technology of CTU in Prague. The thesis deals with its conversion into a Peer-to-peer (P2P) scalable cluster where single nodes can share their computing resources between each other. P2P design oers many benets over a single-master or a multi-master architecture in terms of scalability, reliability and independence. On top of that every participating node can use computing resources of other nodes as well. None of the analyzed existing clusters provides the same functions as we implement to Clondike. Clondike operates on the kernel level thus unmodied system processes can be migrated. Eciency of this universal approach is comparative to task-specic application frameworks what we verify on a set of measurements on dierent types of clusters. An important component of every distributed system is a protocol that connects new nodes and keeps communication between the existing ones. We present an algorithm inspired by protocols used in P2P le-sharing networks. This algorithm reaches a logarithmic scalability and allows Clondike to scale as a global cluster. Clondike is an open source project so we assume that there will be modied Clondike clients that will try to exploit resources of other nodes. We introduce a service blockchain network for o-chain Clondike computations. This network is used to log and verify all transactions so a reputation of each node can be evaluated and unfair nodes can be eliminated. This thesis presents a working version of the proposed Clondike cluster. In particular, the main contributions of the dissertation thesis are as follows: 1. Evaluation of existing peer-to-peer Clondike cluster in laboratory and real-world environments. 2. Introduction of a scalable peer-to-peer inter-node communication and bootstraping protocol. 3. Introduction of a blockchain service network for o-chain computations.