you can install mysql, and apache on your computer. Also can look up noSql db's. Xampp is just a bundled easy to use product. has php mysql and apache bundled into one. But you can install all these separate on you machine.
Yes, it is.
You can do alot of things with these tools without a web server and database server.
But all this just in local machine or in a shared folder.