943,714 Members | Top Members by Rank

Ad:
  • MySQL Discussion Thread
  • Unsolved
  • Views: 5003
  • MySQL RSS
You are currently viewing page 1 of this multi-page discussion thread
Aug 6th, 2008
0

Transfer csv files into a mysql database

Expand Post »
Hey everybody,

My company decided to improve the management of some data contained in csv files by loading their content in a mysql database.

I heard that this is part of the process called ETL. Is that right?
If that's so, which tool can I use in order to do what I describe above.

thanks.
Last edited by Kei; Aug 6th, 2008 at 5:58 pm.
Similar Threads
Kei
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Kei is offline Offline
5 posts
since Aug 2008
Aug 7th, 2008
0

Re: Transfer csv files into a mysql database

Hi kei,

As a matter of fact you have two ways to do it depending on your technical background. You can either write a script yourself or use an ETL tool that will write the most part of the script for you.

Are you more of a technical user or more of a business user ?
gtd
Reputation Points: 18
Solved Threads: 4
Light Poster
gtd is offline Offline
31 posts
since Jul 2008
Aug 9th, 2008
0

Re: Transfer csv files into a mysql database

I would say that I am more on the "business side" than on the technical one.
Kei
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Kei is offline Offline
5 posts
since Aug 2008
Aug 9th, 2008
-1

Re: Transfer csv files into a mysql database

MySQL documentation - LOAD DATA INFILE Syntax. Search page for references of csv for faster location
Moderator
Featured Poster
Reputation Points: 2786
Solved Threads: 871
Code tags enforcer
peter_budo is offline Offline
6,656 posts
since Dec 2004
Aug 11th, 2008
0

Re: Transfer csv files into a mysql database

Indeed, if it is a one-shot project, the fastest way to do it is indeed with :

LOAD DATA INFILE 'path/file.csv' INTO TABLE your_table;

However, if you plan on doing it on a regular basis (if you receive, these very csv files regularly) you may want to use, indeed, an ETL tool.
gtd
Reputation Points: 18
Solved Threads: 4
Light Poster
gtd is offline Offline
31 posts
since Jul 2008
Aug 11th, 2008
0

Re: Transfer csv files into a mysql database

Thanks gtd and peter.

As you said gtd, I would like to do it 3 or 4 times a week.

I will do with "load data infile" now and I will wait for your other suggestion concerning the etl tool.

Why would it be better to use an etl tool if I plan to do it "on a regular basis" ?
Kei
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Kei is offline Offline
5 posts
since Aug 2008
Aug 12th, 2008
0

Re: Transfer csv files into a mysql database

It would not be better but simpler, because you can automate the task with an etl tool, thus allowing you to run the task on a user-defined basis.
gtd
Reputation Points: 18
Solved Threads: 4
Light Poster
gtd is offline Offline
31 posts
since Jul 2008
Aug 12th, 2008
-1

Re: Transfer csv files into a mysql database

This may help you with choosing ETL tool
Moderator
Featured Poster
Reputation Points: 2786
Solved Threads: 871
Code tags enforcer
peter_budo is offline Offline
6,656 posts
since Dec 2004
Aug 12th, 2008
0

Re: Transfer csv files into a mysql database

Thanks for the link peter, it is very interesting.

but the full study need to be purchased...

Anyway, this survey seems a bit old (more than 2 years ago) and since I can't afford to dedicate a budget to the operations mentioned above, I have to choose an open source etl tool which pretty much narrows down the choice.

I will think about it and give my feedback afterwards.
Kei
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Kei is offline Offline
5 posts
since Aug 2008
Aug 22nd, 2008
0

Re: Transfer csv files into a mysql database

I have been using Talend Open Studio for a few days now, and it IS very user-friendly.

I also manage to export an access database to a postgre database very simply.

Thanks for this tool, very very useful and easy to use.
Kei
Reputation Points: 10
Solved Threads: 0
Newbie Poster
Kei is offline Offline
5 posts
since Aug 2008

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.
Message:
Previous Thread in MySQL Forum Timeline: data report for multiple tables
Next Thread in MySQL Forum Timeline: relational db storage and search





About Us | Contact Us | Advertise | Acceptable Use Policy
Forum Index | Build Custom RSS Feed


Follow us on Twitter


© 2011 DaniWeb® LLC