0

Good day, I have to make a data scraper and after I take the informations I have to get them in a CSV file.This is the original request:For the final java academy test you have to create a small crawler.

What do I mean by "crawler"?

A crawler it is a small java program that scans everything from a
website. It is similar to what google is doing when it is indexing the
whole world wide web.

So here are the details.

Your crawler must crawl all the products found in the website www.reifen.com

When you enter this website the first filter is for the type of vehicle.

Crawl ONLY the items found in the category: Vehicle. Ignore motorcycle,
off-road or van.

Bellow you find filters for tyre dimensions. Crawl all those dimensions.

Example for dimensions you have to crawl:

205 55 r16

205 55 r17

215 55 r16

215 55 r17

215 55 r18

...

...

...

and so on

Crawl all the dimensions!

Leave the other filters as they are. Do not change them.

When the list of tires is shown look for brand, tire profile and price

Save this information into a csv file.

Example with 2 lines from the csv file:

205;55;r16;continental;
maxcontact;20EUR
205;55;r17;dunlop;profile_name;30EUR

That's it!

So your crawler must crawl the specified website and save the
information into a CSV file.

I WOULD NEED IT FOR TODATY, THIS IS MY DEATHLINE. iT'S MY FAULT AS A BEGINNER THAT I TRIED BY MYSELF ALL WEEK AND COULD NOT MAKE THE PROGRAM ALONE. TODAT,04.05.17 AT 12:00AM WOULD BE GREAT AS TO SEND IT DIRECTLY.MY TIMELINE IS UTC+2:00 ATHENS,BUCHAREST.NOW IS 5.34AM(I TRIED FROM YESTERDAY AT 20:00 UNTIL NOW BUT STILL NO SUCCES. My email is petrisor_cristian93@yahoo.com I know the ids and that it would br good to use a streambuilder and the csv filewith FireWriter method

Edited by Petrisor

2
Contributors
1
Reply
27
Views
3 Months
Discussion Span
Last Post by happygeek
4

Show us your code so far if you expect to get help with this my friend. Nobody is going to do your assignment for you, but they will point you in the right direction...

Have something to contribute to this discussion? Please be thoughtful, detailed and courteous, and be sure to adhere to our posting rules.