I am using Spark 1.3.0 with python api. While transforming huge dataframes, I cache many DFs for faster execution;
Once use of certain dataframe is over and is no longer needed how can I drop DF from memory (or un-cache it??)?
For example, df1 is used through out the code while df2 is utilized for few transformations and after that, it is never needed. I want to forcefully drop df2 to release more memory space.