Back

Explore Courses Blog Tutorials Interview Questions

What is DAG in Spark?

0 votes
2 views
in Big Data Hadoop & Spark by (6.5k points)

Can anyone explain the DAG in Spark?

1 Answer

0 votes
by (11.3k points)

DAG is the abbreviation of the Directed Acyclic Graph. In Spark, this is used for the visual representation of RDDs and the operations being performed on them. The RDDs are represented by vertices, while the operations are represented by edges. Every edge is directed from an 'earlier state' to a 'later state.'

If you are looking for an online course to learn Spark, check out this Apache Spark Certification program by Intellipaat.

Related questions

0 votes
1 answer
How DAG works under the covers in RDD?
asked Jul 10, 2019 in Big Data Hadoop & Spark by Aarav (11.4k points)
0 votes
1 answer
What is 'In-Memory Computation' in Spark?
asked Apr 20, 2021 in Big Data Hadoop & Spark by dev_sk2311 (45k points)
0 votes
1 answer
What is Lazy Evaluation in Spark?
asked Apr 20, 2021 in Big Data Hadoop & Spark by dev_sk2311 (45k points)
0 votes
1 answer
What is driver memory in Spark?
asked Jul 9, 2020 in Big Data Hadoop & Spark by angadmishra (6.5k points)

Browse Categories

© COPYRIGHT 2011-2023 INTELLIPAAT.COM. ALL RIGHTS RESERVED.

Download Salary Trends Now !

Learn how professionals like you got up to 100% Salary Hike.

...