I'm looking to write a program that should be capable of holding around 1000 records, each record will contain a varying number of fields and values.
Usually, I'd create a list of dictionaries for something like this but wanted to know if that's the right way to go about it. This data will be routinely sorted and searched.
For something of this volume, is it better (from a performance perspective) to use an SQL database or can I build an equally fast solution in Python. What does industry use? Can I get better performance implementing a different type of data structure in Python?
Any input would be much appreciated!