Can Hive Joins be implemented in Apache Nifi?

Question

I need to implement Hive Joins from Apache Nifi.

I found PutHiveQL, PutHiveStreaming and SelectHiveQL processors in Apache nifi, but was not able to find any use case regarding the Hive Joins implementation.

Answer 1

You can join Hive queries in Apache Nifi but I would suggest you not to as it is a difficult process and inefficient.

If you want to join regular queries in Hive, use those normal Hive processors(PutHiveQL, PutHiveStreaming, and SelectHiveQL) as usual with join queries statements. But if you join different regular queries in, it is irrelevant. Nifi is not used for joining Hive queries, It is almost impossible to do that in Nifi. (It is only possible using MergeSort and MergeContent processors and that is a very difficult process)

To learn more about NiFi configuration, you can join Apache NiFi Training and Tutorial.

For more information regarding the same, refer to the following video: