Vstříc decentralizovanému peer-to-peer clusteru
Towards a decentralised peer-to-peer cluster
Type of document
disertační prácedoctoral thesis
Author
Gattermayer Josef
Supervisor
Tvrdík Pavel
Opponent
Schill Alexander
Field of study
InformatikaStudy program
InformatikaInstitutions assigning rank
katedra počítačových systémůDefended
2018-06-26Rights
A university thesis is a work protected by the Copyright Act. Extracts, copies and transcripts of the thesis are allowed for personal use only and at one?s own expense. The use of thesis should be in compliance with the Copyright Act http://www.mkcr.cz/assets/autorske-pravo/01-3982006.pdf and the citation ethics http://knihovny.cvut.cz/vychova/vskp.htmlVysokoškolská závěrečná práce je dílo chráněné autorským zákonem. Je možné pořizovat z něj na své náklady a pro svoji osobní potřebu výpisy, opisy a rozmnoženiny. Jeho využití musí být v souladu s autorským zákonem http://www.mkcr.cz/assets/autorske-pravo/01-3982006.pdf a citační etikou http://knihovny.cvut.cz/vychova/vskp.html
Metadata
Show full item recordAbstract
The Clondike - CLuster Of Non-Dedicated Interoperating KErnels - is a long term research project of a non-dedicated cluster architecture at the Faculty of Information Technology of CTU in Prague. The thesis deals with its conversion into a Peer-to-peer (P2P) scalable cluster where single nodes can share their computing resources between each other. P2P design oers many benets over a single-master or a multi-master architecture in terms of scalability, reliability and independence. On top of that every participating node can use computing resources of other nodes as well. None of the analyzed existing clusters provides the same functions as we implement to Clondike. Clondike operates on the kernel level thus unmodied system processes can be migrated. Eciency of this universal approach is comparative to task-specic application frameworks what we verify on a set of measurements on dierent types of clusters. An important component of every distributed system is a protocol that connects new nodes and keeps communication between the existing ones. We present an algorithm inspired by protocols used in P2P le-sharing networks. This algorithm reaches a logarithmic scalability and allows Clondike to scale as a global cluster. Clondike is an open source project so we assume that there will be modied Clondike clients that will try to exploit resources of other nodes. We introduce a service blockchain network for o-chain Clondike computations. This network is used to log and verify all transactions so a reputation of each node can be evaluated and unfair nodes can be eliminated. This thesis presents a working version of the proposed Clondike cluster. In particular, the main contributions of the dissertation thesis are as follows: 1. Evaluation of existing peer-to-peer Clondike cluster in laboratory and real-world environments. 2. Introduction of a scalable peer-to-peer inter-node communication and bootstraping protocol. 3. Introduction of a blockchain service network for o-chain computations. The Clondike - CLuster Of Non-Dedicated Interoperating KErnels - is a long term research project of a non-dedicated cluster architecture at the Faculty of Information Technology of CTU in Prague. The thesis deals with its conversion into a Peer-to-peer (P2P) scalable cluster where single nodes can share their computing resources between each other. P2P design oers many benets over a single-master or a multi-master architecture in terms of scalability, reliability and independence. On top of that every participating node can use computing resources of other nodes as well. None of the analyzed existing clusters provides the same functions as we implement to Clondike. Clondike operates on the kernel level thus unmodied system processes can be migrated. Eciency of this universal approach is comparative to task-specic application frameworks what we verify on a set of measurements on dierent types of clusters. An important component of every distributed system is a protocol that connects new nodes and keeps communication between the existing ones. We present an algorithm inspired by protocols used in P2P le-sharing networks. This algorithm reaches a logarithmic scalability and allows Clondike to scale as a global cluster. Clondike is an open source project so we assume that there will be modied Clondike clients that will try to exploit resources of other nodes. We introduce a service blockchain network for o-chain Clondike computations. This network is used to log and verify all transactions so a reputation of each node can be evaluated and unfair nodes can be eliminated. This thesis presents a working version of the proposed Clondike cluster. In particular, the main contributions of the dissertation thesis are as follows: 1. Evaluation of existing peer-to-peer Clondike cluster in laboratory and real-world environments. 2. Introduction of a scalable peer-to-peer inter-node communication and bootstraping protocol. 3. Introduction of a blockchain service network for o-chain computations.
View/ Open
Collections
Related items
Showing items related by title, author, creator and subject.
-
Meta optimalizace shlukové analýzy
Author: Tomáš Bartoň; Supervisor: Kordík Pavel; Opponent: Platoš Jan
(České vysoké učení technické v Praze. Vypočetní a informační centrum.Czech Technical University in Prague. Computing and Information Centre., 2019-05-30)This dissertation thesis deals with advances in the automation of cluster analysis. -
Klastrovací metody pro datovou analýzu
Author: Kryštof Bystřický; Supervisor: Jura Jakub; Opponent: Cejnek Matouš
(České vysoké učení technické v Praze. Vypočetní a informační centrum.Czech Technical University in Prague. Computing and Information Centre., 2019-08-30)V této práci jsou popsány základní techniky data miningu. Podrobně je popsána především klastrová(shluková) analýza, tedy seskupování objektů na základě jejich podobností. Značná část teoretické části se zabývá předpřípravou ... -
Distribuované výpočty na RaspberryPi klastru
Author: Roman Janků; Supervisor: Vokřínek Jiří; Opponent: Bureš Miroslav
(České vysoké učení technické v Praze. Vypočetní a informační centrum.Czech Technical University in Prague. Computing and Information Centre., 2022-06-01)Tato bakalářská práce se zabývá vývojem platformy pro vývoj a měření distribuovaných algoritmů na clusteru RaspberryPi. V programovacím jazyce Java byla vyvinuta client-server aplikace, která umožňuje měření jak již ...