Vstříc decentralizovanému peer-to-peer clusteru
Towards a decentralised peer-to-peer cluster
Typ dokumentu
disertační prácedoctoral thesis
Autor
Gattermayer Josef
Vedoucí práce
Tvrdík Pavel
Oponent práce
Schill Alexander
Studijní obor
InformatikaStudijní program
InformatikaInstituce přidělující hodnost
katedra počítačových systémůObhájeno
2018-06-26Práva
A university thesis is a work protected by the Copyright Act. Extracts, copies and transcripts of the thesis are allowed for personal use only and at one?s own expense. The use of thesis should be in compliance with the Copyright Act http://www.mkcr.cz/assets/autorske-pravo/01-3982006.pdf and the citation ethics http://knihovny.cvut.cz/vychova/vskp.htmlVysokoškolská závěrečná práce je dílo chráněné autorským zákonem. Je možné pořizovat z něj na své náklady a pro svoji osobní potřebu výpisy, opisy a rozmnoženiny. Jeho využití musí být v souladu s autorským zákonem http://www.mkcr.cz/assets/autorske-pravo/01-3982006.pdf a citační etikou http://knihovny.cvut.cz/vychova/vskp.html
Metadata
Zobrazit celý záznamAbstrakt
The Clondike - CLuster Of Non-Dedicated Interoperating KErnels - is a long term research project of a non-dedicated cluster architecture at the Faculty of Information Technology of CTU in Prague. The thesis deals with its conversion into a Peer-to-peer (P2P) scalable cluster where single nodes can share their computing resources between each other. P2P design oers many benets over a single-master or a multi-master architecture in terms of scalability, reliability and independence. On top of that every participating node can use computing resources of other nodes as well. None of the analyzed existing clusters provides the same functions as we implement to Clondike. Clondike operates on the kernel level thus unmodied system processes can be migrated. Eciency of this universal approach is comparative to task-specic application frameworks what we verify on a set of measurements on dierent types of clusters. An important component of every distributed system is a protocol that connects new nodes and keeps communication between the existing ones. We present an algorithm inspired by protocols used in P2P le-sharing networks. This algorithm reaches a logarithmic scalability and allows Clondike to scale as a global cluster. Clondike is an open source project so we assume that there will be modied Clondike clients that will try to exploit resources of other nodes. We introduce a service blockchain network for o-chain Clondike computations. This network is used to log and verify all transactions so a reputation of each node can be evaluated and unfair nodes can be eliminated. This thesis presents a working version of the proposed Clondike cluster. In particular, the main contributions of the dissertation thesis are as follows: 1. Evaluation of existing peer-to-peer Clondike cluster in laboratory and real-world environments. 2. Introduction of a scalable peer-to-peer inter-node communication and bootstraping protocol. 3. Introduction of a blockchain service network for o-chain computations. The Clondike - CLuster Of Non-Dedicated Interoperating KErnels - is a long term research project of a non-dedicated cluster architecture at the Faculty of Information Technology of CTU in Prague. The thesis deals with its conversion into a Peer-to-peer (P2P) scalable cluster where single nodes can share their computing resources between each other. P2P design oers many benets over a single-master or a multi-master architecture in terms of scalability, reliability and independence. On top of that every participating node can use computing resources of other nodes as well. None of the analyzed existing clusters provides the same functions as we implement to Clondike. Clondike operates on the kernel level thus unmodied system processes can be migrated. Eciency of this universal approach is comparative to task-specic application frameworks what we verify on a set of measurements on dierent types of clusters. An important component of every distributed system is a protocol that connects new nodes and keeps communication between the existing ones. We present an algorithm inspired by protocols used in P2P le-sharing networks. This algorithm reaches a logarithmic scalability and allows Clondike to scale as a global cluster. Clondike is an open source project so we assume that there will be modied Clondike clients that will try to exploit resources of other nodes. We introduce a service blockchain network for o-chain Clondike computations. This network is used to log and verify all transactions so a reputation of each node can be evaluated and unfair nodes can be eliminated. This thesis presents a working version of the proposed Clondike cluster. In particular, the main contributions of the dissertation thesis are as follows: 1. Evaluation of existing peer-to-peer Clondike cluster in laboratory and real-world environments. 2. Introduction of a scalable peer-to-peer inter-node communication and bootstraping protocol. 3. Introduction of a blockchain service network for o-chain computations.
Zobrazit/ otevřít
Kolekce
Související záznamy
Zobrazují se záznamy příbuzné na základě názvu, autora a předmětu.
-
Meta optimalizace shlukové analýzy
Autor: Tomáš Bartoň; Vedoucí práce: Kordík Pavel; Oponent práce: Platoš Jan
(České vysoké učení technické v Praze. Vypočetní a informační centrum.Czech Technical University in Prague. Computing and Information Centre., 2019-05-30)This dissertation thesis deals with advances in the automation of cluster analysis. -
Klastrovací metody pro datovou analýzu
Autor: Kryštof Bystřický; Vedoucí práce: Jura Jakub; Oponent práce: Cejnek Matouš
(České vysoké učení technické v Praze. Vypočetní a informační centrum.Czech Technical University in Prague. Computing and Information Centre., 2019-08-30)V této práci jsou popsány základní techniky data miningu. Podrobně je popsána především klastrová(shluková) analýza, tedy seskupování objektů na základě jejich podobností. Značná část teoretické části se zabývá předpřípravou ... -
Distribuované výpočty na RaspberryPi klastru
Autor: Roman Janků; Vedoucí práce: Vokřínek Jiří; Oponent práce: Bureš Miroslav
(České vysoké učení technické v Praze. Vypočetní a informační centrum.Czech Technical University in Prague. Computing and Information Centre., 2022-06-01)Tato bakalářská práce se zabývá vývojem platformy pro vývoj a měření distribuovaných algoritmů na clusteru RaspberryPi. V programovacím jazyce Java byla vyvinuta client-server aplikace, která umožňuje měření jak již ...