To make a button in the column, use the DataGridViewButtonColumn object. Then, you can create an onclick event to handle your editing/deleting.
DataGridViewButtonColumn buttonColumn =
new DataGridViewButtonColumn();
buttonColumn.HeaderText = "Delete/Edit";
I know that code to remove a row is:
DataGridView1.Rows.RemoveAt(index)
Hope that helps.