add textual comparisonHEADmaster

structural comparison helps detect a vast majority of duplicates, but it
has a few false positives when files contain only trivia. textual
similarity can help detect and eliminate those false positives.

1 files changed, 1 insertions, 0 deletions

diff --git a/Cargo.toml b/Cargo.toml
index 579c1c4..2803272 100644
--- a/Cargo.toml
+++ b/Cargo.toml
@@ -17,3 +17,4 @@ tree-sitter = "0.20"
 itertools = "0.10"
 rayon = "1.5"
 thiserror = "1.0"
+simhash = "0.2"