Hi guys, I recently purchased a domain that I will use for my website. I was wondering how can I set it up so I can have an email like admin@mydomain.com

How are you currently hosting your website? Do you have a hosting company? If so, you can setup MX records to point the domain to using your current server to manage your email.

Lots of domain registrars also handle email for a few bucks a month. See if your domain registrar does.

Or, you can use other services such as custom Gmail, which also costs a few bucks a month. I use Microsoft Office 365 Hosted Exchange, personally.

I am using hostgator for my hosting. I heard there's a way to set it up using Google Apps. Is this still free?

Go to option to Set Up Custom Email Address With Gmail for Free!

Thats better way

to Personalize your email by getting email addresses at your domain.

to Create addresses for your team like company.com.

So much user friendly.