Dealing with reposts

[wanyek43]

It occurred to me this morning as I started to run low on space on my external drive that a lot of profiles repost constantly. Images aren't a concern, but some of these models repost videos that are fairly large. I just cleaned out reposts from Dani Daniels where I found videos reposted up to 5 times! After manually clearing them out, I got back another like 30GB. her content still comes out to over 80GB, but that was a significant chunk of reposts. I am now going through them manually to get more space, but obviously it's very tedious. Anyone else realize this, and how are you handling it?

Edit: I should clarify that some of them appear to exact copies, which could probably be picked up on by a deduplication program, but some of them are cut ever so slightly differently. Those differences are usually an intro/outro change or added or a slight trim.