Back

Explore Courses Blog Tutorials Interview Questions
0 votes
2 views
in Big Data Hadoop & Spark by (12.9k points)

Can anyone tell me what is UDF in PySpark?

1 Answer

0 votes
by (108k points)

It is similar to UDFs of SQL and other traditional databases. In PySpark, UDF is a short form for User Defined Functions, which you can use to create a function in Python and wrap it with PySpark SQL UDF() or register it as UDFfor using it on DataFrame and SQL respectively.

If you are looking for an online course to learn PySpark, check out this PySpark Training course by Intellipaat.

Also, check out this video for more information:

Related questions

0 votes
1 answer
0 votes
1 answer
asked Sep 23, 2020 in Big Data Hadoop & Spark by Amyra (12.9k points)
0 votes
1 answer
asked Feb 7, 2020 in Big Data Hadoop & Spark by anmolj (9k points)

Browse Categories

...