Basically what I want to do is download all a users facebook and twitter friends and somehow find a way to figure out which entries represent the same person. I know it's possible because a lot of social search sites like spokeo achieve what I want and more, so does anyone know how they go about doing it or the best way to go about it?
I have a basic idea of the facebook and twitter api calls I need to be making however feel free to add any advice or warnings there as well. I know facebook hashes the emails which seems like it could pose a problem.
Any help is greatly appreciated.
I would allow the users to make associations themselves. Then use these associations as suggestions for future users. Over time you'll gather quite a well made associations from your users. Possibly using email addresses and names as suggestion points.