You must add the KeyListener to a component with the addKeyListener() method. It's similar to what you did with the ActionListener for the buttons.
Implementing the interface just defines what the listener does. Then you attach it to the component you want to listen to.