Scribd
Upload
7 views

Doc2 2

Lesson

Uploaded by

Racel Cagnayo
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
7 views

Doc2 2

Lesson

Uploaded by

Racel Cagnayo
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

Slide 1: Title Slide

Title: Introduction to Parallel and Distributed Computing


Subtitle: Week 1: Fundamentals and Concepts
 Course Name
 Your Name/Institution
 Date

Slide 2: Learning Objectives


Title: Learning Objectives
Content:
 Define parallel and distributed computing.
 Understand key differences between the two paradigms.
 Explore motivations and applications of these computing models.
 Introduce performance metrics (speedup, efficiency, scalability).
 Discuss parallel architectures: shared memory vs. distributed memory.

Slide 3: Definitions
Title: What are Parallel and Distributed Computing?
Content:
1. Parallel Computing:
o Multiple processors or cores work simultaneously on a single problem.

o Examples: Multi-core CPUs, GPUs.

2. Distributed Computing:
o A collection of independent computers working together on a problem.

o Examples: Cluster computing, cloud computing.

Graphic: Diagram illustrating processors in parallel computing vs. nodes in


distributed computing.

Slide 4: Key Differences


Title: Parallel vs. Distributed Computing
Table or Bullet Points:
Feature Parallel Computing Distributed Computing

Single system, multiple Multiple systems


Definition
processors interconnected

Communicati Message passing, slower


Shared memory, fast access
on access

Hardware Multi-core CPUs, GPUs Clusters, cloud servers

Weather modeling,
Examples Cloud storage, web services
simulations

Visual: Table or infographic.

Slide 5: Motivation
Title: Why Parallel and Distributed Computing?
Content:
 Growing Data Sizes: Big data applications.
 Performance Needs: Faster processing for complex tasks.
 Scalability: Efficiently handle increased workloads.
 Applications:
o High-Performance Computing (HPC): Weather forecasting, protein
folding.
o Cloud Computing: Web applications, big data analytics.

Graphic: Industry trends or a word cloud with terms like "Big Data," "HPC," and
"AI."

Slide 6: Applications
Title: Applications of Parallel and Distributed Computing
Content:
 HPC:
o Large-scale simulations (e.g., aerospace, climate models).

 Cloud Computing:
o Platforms like AWS, Google Cloud for scalable applications.

 AI & Machine Learning:


o Training neural networks on GPUs and clusters.
 Real-Time Systems:
o Stock trading, medical imaging.

Graphic: Examples in specific industries (diagrams or images).

Slide 7: Performance Metrics


Title: Performance Metrics
Content:
1. Speedup:
o Ratio of time taken by a single processor to time with multiple
processors.
o Speedup=T1Tp\text{Speedup} = \frac{T_1}{T_p}Speedup=TpT1

2. Efficiency:
o How effectively resources are used.

o Efficiency=SpeedupP\text{Efficiency} = \frac{\text{Speedup}}
{P}Efficiency=PSpeedup, where PPP is the number of processors.
3. Scalability:
o System's ability to handle increased workload proportionally.

Graphic: Example graph of speedup vs. processors.

Slide 8: Parallel Architectures


Title: Parallel Architectures: Shared vs. Distributed Memory
Content:
1. Shared Memory:
o Single memory space accessible to all processors.

o Advantages: Faster communication, easier to program.

o Disadvantages: Limited scalability.

2. Distributed Memory:
o Each processor has its own memory.

o Advantages: Highly scalable.

o Disadvantages: Requires explicit communication.


Graphic: Diagrams of shared memory (e.g., SMP system) and distributed memory
(e.g., cluster).

Slide 9: Real-World Examples


Title: Real-World Systems
Content:
 Parallel Systems:
o NVIDIA GPUs for deep learning.

o Multi-core CPUs for video rendering.

 Distributed Systems:
o Google Search using distributed clusters.

o Netflix content delivery via cloud servers.

Graphic: Case studies or examples with logos (e.g., NVIDIA, AWS).

Slide 10: Summary


Title: Key Takeaways
Content:
 Parallel computing focuses on simultaneous execution in a single system.
 Distributed computing involves multiple systems communicating over a
network.
 Performance metrics (speedup, efficiency, scalability) help evaluate systems.
 Shared and distributed memory architectures cater to different applications.
Graphic: Overview diagram summarizing the topics covered.

You might also like