Member Avatar

I am looking to create a program that works similarly like wolfram alpha but on a much more basic level. It will use things like weather, directions, restaurants in an area etc. Im looking to some how build this system (elementary) so that it can accomplish something like this:

I wanted to know if anyone knows the best way to approach this, and is there any open source system that could help.