Hello typhoon.

I'd recommend you have a look at an ETL tool. It allows, among other things, to "clean up data" including deleting duplicate records. Also I know there are open source ETL tools, making it pretty easy to download.

I've been looking at those etl tools you talk about and would like to know which, among the open source etl tools, is the easiest to use? I'm asking because now I've seen what I can do with these tools, I'll use them on a regular basis (data integration?).

Once I've chosen the one I'm going to use, I will come back with more technical questions.

Thanks for your answers.

Have a look at Talend Open Studio: it is user-friendly, allowing business users to use it. But it also has advanced features intended for technical users (java debugger, code injection…).

Simply put, it is a powerful tool but easy to handle. Go on their website http://www.talend.com/solutions-data...-migration.php . They have a forum and documentation you can read. Tell us what you think about the software.