When I upgraded to Ubuntu 10.4 the pop-up windows for my Evolution Calendar Alarms quit working. I would get a small icon on my task bar that let me know I had a calendar event to look at, but the alarm window no longer was shown.
On the Evolution file menu select Edit->Preferences->Calander and Tasks->Alarms and uncheck the box labeled "Display alarms in notification area only".
You may have to restart Evolution for the change to take place. Use "evolution --force-shutdown" to make sure the calendar application is restarted.