I haven't had to use a ListView, but I believe this is how you would do it in your delete click event. Somebody will correct me if I am wrong:
ListView.SelectedListViewItemCollection items = lv.SelectedItems;
foreach (ListViewItem item in items)
item.Remove();