Using a csv file would only be a good choice if the program would allow for multiple users, or for multiple sets of data, or on a portable media such as a flash drive and you wanted to be able to save settings and data together for load when necessary.
the C# system settings located in the properties namespace actually saves the preferences in the user folder on the harddrive, C:\Documents and Settings\User\Local Settings\Application Data\programname\exename and identifiing data\buildnumber\user.settings
and is very simple to use, automatically creates the file on run if the system lacks one. and the data stays persistant. So even if it was a standalone app. and you were running it off a flash drive, as long as its used on the same computer and the same user. The settings would load.
So, in most cases. I agree with ddanbe. the properties.settings method is the best and easiest way to go about something simple like this.