https://github.com/onesuper/HuggingFace-Datasets-Text-Quality-Analysis/blob/92f66886bf96824ebbe59f55e037413069f8429c/app.py#L486 After lsh.query, before added into unique_documents, results.remove(str(i)) ?
HuggingFace-Datasets-Text-Quality-Analysis/app.py
Line 486 in 92f6688
After lsh.query, before added into unique_documents,
results.remove(str(i)) ?