Pergunta de entrevista da empresa TransUnion

Remove duplicates from spark dataframe without using in built function. Handle null values.