Recent questions and answers in Big Data Hadoop & Spark

0 votes

1 answer 1 view

What is spark.driver.maxResultSize?

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

0 votes

1 answer 1 view

How to create dataframe from list in Spark SQL?

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

0 votes

1 answer 1 view

Spark Kill Running Application

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

0 votes

2 answers 1 view

How does createOrReplaceTempView work in Spark?

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

+1 vote

2 answers 1 view

Spark - SELECT WHERE or filtering?

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

0 votes

1 answer 1 view

Joining Spark dataframes on the key

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

0 votes

1 answer 1 view

What is the difference between spark.sql.shuffle.partitions and spark.default.parallelism?

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

+1 vote

2 answers 1 view

What is RDD in spark

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

0 votes

1 answer 1 view

Xml processing in Spark

answered 2 days ago in Big Data Hadoop & Spark by Anurag (31.9k points)

+2 votes

6 answers 1 view

Convert pyspark string to date format

answered 2 days ago in Big Data Hadoop & Spark by Vishal (32.5k points)

+3 votes

6 answers 1 view

Pyspark: Exception: Java gateway process exited before sending the driver its port number

answered 2 days ago in Big Data Hadoop & Spark by Vishal (32.5k points)

+3 votes

6 answers 1 view

Best way to get the max value in a Spark dataframe column

answered 3 days ago in Big Data Hadoop & Spark by Soni Kumari (25.9k points)

+4 votes

5 answers 1 view

How do we concatenate two columns in an Apache Spark DataFrame? Is there any function in Spark SQL which we can use?

answered 3 days ago in Big Data Hadoop & Spark by Vishal (32.5k points)

+16 votes

6 answers 2 views

what's the difference between “hadoop fs” shell commands and “hdfs dfs” shell commands?

answered 3 days ago in Big Data Hadoop & Spark by Vishal (32.5k points)

+4 votes

4 answers 1 view

I need to skip three rows from the dataframe while loading from a CSV file in scala

answered 3 days ago in Big Data Hadoop & Spark by Vishal (32.5k points)

+5 votes

5 answers 1 view

Removing duplicates from rows based on specific columns in an RDD/Spark DataFrame

answered 5 days ago in Big Data Hadoop & Spark by Rajesh Malhotra (5.9k points)

+5 votes

3 answers 1 view

Spark DataFrame groupBy and sort in the descending order (pyspark)

answered Aug 12 in Big Data Hadoop & Spark by vinita (36.8k points)

+5 votes

3 answers 1 view

Apache Spark - foreach Vs foreachPartitions When to use What?

answered Aug 9 in Big Data Hadoop & Spark by vinita (36.8k points)

0 votes

0 answers 1 view

Can the config file contain 2 values. How will be the behavior when we perform execution?

asked Aug 5 in Big Data Hadoop & Spark by Asmi (120 points)

0 votes

1 answer 1 view

How to use orderby() with descending order in Spark window functions?

answered Aug 5 in Big Data Hadoop & Spark by Amit Rawat (24.7k points)

Recent questions and answers in Big Data Hadoop & Spark

Categories