Recent questions and answers in Big Data Hadoop & Spark

0 votes

2 answers

Spark SQL Row_number() PartitionBy Sort Desc

answered Jan 7 in Big Data Hadoop & Spark by Sumitha (2.6k points)

0 votes

2 answers

Pyspark filter dataframe by columns of another dataframe

answered Jan 4 in Big Data Hadoop & Spark by Asha (1.9k points)

+3 votes

7 answers

Best way to get the max value in a Spark dataframe column

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

+13 votes

4 answers

Hadoop “Unable to load native-hadoop library for your platform” warning

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

+1 vote

3 answers

How to check the Spark version

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

0 votes

2 answers

Create Spark DataFrame. Can not infer schema for type: <type 'float'>

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

Want to get 50% Hike on your Salary?

Learn how we helped 50,000+ professionals like you !

0 votes

2 answers

How to deal with executor memory and driver memory in Spark?

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

0 votes

2 answers

Converting Pandas dataframe into Spark dataframe error

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

0 votes

3 answers

Spark: “Truncated the string representation of a plan since it was too large.” Warning when using manually created aggregation expression

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

+10 votes

4 answers

How to copy file from HDFS to the local file system

answered Nov 8, 2024 in Big Data Hadoop & Spark by Aparna (3.5k points)

0 votes

3 answers

what is nullable = true or false in spark scala?where need to use this?

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

+1 vote

3 answers

How can I delete all the messages from a Kafka topic?

answered Nov 8, 2024 in Big Data Hadoop & Spark by Anandita (1.9k points)

0 votes

2 answers

What are the differences between PySpark and Spark?

answered Nov 8, 2024 in Big Data Hadoop & Spark by Yashika (2.9k points)

+4 votes

5 answers

I need to skip three rows from the dataframe while loading from a CSV file in scala

answered Nov 8, 2024 in Big Data Hadoop & Spark by Chitra (2.7k points)

+6 votes

3 answers

The way to check a HDFS directory's size? Ask

answered Nov 8, 2024 in Big Data Hadoop & Spark by Chitra (2.7k points)

0 votes

2 answers

How to link PyCharm with PySpark?

answered Nov 8, 2024 in Big Data Hadoop & Spark by Asha (1.9k points)

0 votes

2 answers

Spark java.lang.OutOfMemoryError: Java heap space

answered Nov 8, 2024 in Big Data Hadoop & Spark by Yashika (2.9k points)

0 votes

2 answers

FetchFailedException or MetadataFetchFailedException when processing big data set

answered Nov 8, 2024 in Big Data Hadoop & Spark by Sumitha (2.6k points)

0 votes

2 answers

pyhive: Connect to Hive using Pyhive

answered Nov 8, 2024 in Big Data Hadoop & Spark by Aparna (3.5k points)

0 votes

3 answers

Which of the following is true of Big Data?

answered Nov 8, 2024 in Big Data Hadoop & Spark by Aparna (3.5k points)

Show More questions in this category.

Recent questions and answers in Big Data Hadoop & Spark

...