I have a csv that has over 800,000 records that gets loaded into my db via SSIS package routines. However, there are about 190 records that I do not want to be loaded into the the database. The csv comes from an external source and is unaltered at package runtime. In order to not load these records, I made a table to control load variables but I'm not sure how to use it nor do I know if it is the right approach. Basically my thoughts are:`
if a record identifier from the csv file matches the record identifier from the Exclusion table, exclude it, else load db.
If someone can set me straight on a proper approach I would truly appreciate it.