Filtering a row in Spark DataFrame based on matching values from a list

Question

I am filtering the Spark DataFrame using filter:

var notFollowingList=List(9.8,7,6,3,1)

df.filter(col("uid”).isin(notFollowingList))

But I get an error saying:

Unsupported literal type classscala.collection.immutable.$colon$colon 

Can anyone help me in resolving the error?

Answer 1

Simply use the function as following:

var notFollowingList=List(9.8,7,6,3,1)

df.filter(col("uid").isin(notFollowingList:_*))

I hope this answer would help you!