Analytical Modeling of Parallel Systems-Parallel Computing-Lecture Slides, Slides of Parallel Computing and Programming

This lecture was delivered by Dr. Hanif Durad at Pakistan Institute of Engineering and Applied Sciences, Islamabad (PIEAS) for Parallel Computing course. it includes: Analytical, Modeling, Parallel, Systems, Performance, Metrics, Granularity, Execution, Time, Asymptotic, Analysis, Broadcast, Rings

Typology: Slides

2011/2012

Uploaded on 07/19/2012

adnaan
adnaan 🇵🇰

4

(1)

13 documents

1 / 6

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Dr. Hanif Durad 2
Lecture Outline
Sources of Overhead in Parallel Programs
Performance Metrics for Parallel Systems
Effect of Granularity on Performance
Scalability of Parallel Systems
Minimum Execution Time and Minimum Cost-Optimal
Execution Time
Asymptotic Analysis of Parallel Programs
Other Scalability Metrics
pf3
pf4
pf5

Partial preview of the text

Download Analytical Modeling of Parallel Systems-Parallel Computing-Lecture Slides and more Slides Parallel Computing and Programming in PDF only on Docsity!

Dr. Hanif Durad

2

Lecture Outline  Sources of Overhead in Parallel Programs  Performance Metrics for Parallel Systems  Effect of Granularity on Performance  Scalability of Parallel Systems  Minimum Execution Time and Minimum Cost-OptimalExecution Time  Asymptotic Analysis of Parallel Programs  Other Scalability Metrics

Dr. Hanif Durad

3

Broadcast and Reduction on a

Mesh: Example One-to-all broadcast on a 16-node

mesh.

4.1.3 Broadcast and Reduction ona Hypercube (1/2)  d phases on

d -dimension hypercube

^ phase i:^ ^2

(i-1)^ messages  sent in parallel  in dimension i

^ source node = 000, d = 3^ ^ Phase 1: 000 -> 100^ ^ Phase 2: 000 -> 010

^ Phase 3: 000 -> 001