Master Thesis - ICS

Table of Contents
Chapter 1. Introduction.......................................................................................................... 1
Chapter 2. The Grid: A High-Performance Computational Architecture ............................. 5
2.1 What is a Grid? ................................................................................................................ 5
2.2 Virtual Organizations.......................................................................................................6
2.3 The Evolution of the Grid................................................................................................ 8
2.3.1 The First Generation ............................................................................................... 9
2.3.2 The Second Generation........................................................................................... 9
2.3.3 The Third Generation............................................................................................ 11
2.4 The Nature of the Grid Architecture.............................................................................. 12
2.4.1 Fabric: Interfaces to Local Control....................................................................... 13
2.4.2 Connectivity: Communicating Easily and Safely................................................. 15
2.4.3 Resource: Sharing single Resources ..................................................................... 16
2.4.4 Collective: Coordinating Multiple Resources....................................................... 17
2.4.5 Applications .......................................................................................................... 20
2.4.6 Grid Architecture in Practice ................................................................................ 20
Chapter 3. The High-Performance Scheduling Problem..................................................... 22
3.1 What is Application Scheduling?................................................................................... 23
3.2 Developing a Grid Scheduling Model ........................................................................... 24
3.3 Scheduling via Dynamic Programming......................................................................... 26
3.4 Current Efforts on Schedulers for Grid systems............................................................ 29
3.5 An Overview of Our Work ............................................................................................ 32
Chapter 4. Join Relational Operator .................................................................................... 35
4.1 Overview........................................................................................................................ 35
4.2 Types of Join.................................................................................................................. 36
4.3 Join Evaluation Methods................................................................................................ 43
4.3.1 Nested-loops join .................................................................................................. 43
4.3.2 Sort-merge join ..................................................................................................... 44
4.3.3 Hash-based join .................................................................................................... 47
4.4 Join Size Estimation....................................................................................................... 49
4.4.1 Naïve Method........................................................................................................ 50
4.4.2 Probabilistic Estimation........................................................................................ 52
4.4.3 Parametric Estimation........................................................................................... 54
4.4.4 Histograms ............................................................................................................ 56
Chapter 5. Data Replication in Distributed Database Systems ........................................... 59
5.1 Full Database Replication.............................................................................................. 59
5.2 No Database Replication................................................................................................ 60
5.3 Partial Data Replication ................................................................................................. 60
5.3.1 Exact Partial Data Replication.............................................................................. 61
5.3.2 Non-Exact Partial Data Replication...................................................................... 71
Chapter 6. QuPGC: Query Plan Graph Constructor............................................................ 74
viii