Hi, Wonder if anyone here can help with this:
I'm trying to split each line of data from a text file into a list or tuple.
The lines contain a mixture of ints, floats, and strings (with spaces).
I can do it easily enough using split() twice - once by " ' " and then by space. I was hoping to use the csv module - but that only seems to work if the text is separated by one space - and in these files, there can be many spaces between the numbers.
Is there a concise way of splitting up lines like these using a regex, or some other clever method?

10471 'AGHADA71' 20.00 2 0.00 0.00 1 1 1.0106 0.312
10475 'AGHADA75' 21.00 2 0.00 0.00 1 1 0.9940 -1.217
10810 'AHANE 10' 110.00 1 0.00 0.00 1 1 1.0517 -4.091

Thanks in advance!

I use readline() to obtain the text from the file, so input looks something like:
"10210 'ARDNA 10' 110.00 1 0.00 0.00 1 1 1.0432 -3.954"
Then I would like to split according to space but to ignore the possible spaces within the string, i.e. to get an output like
(10210, "ARDNA 10", 110.00, 1, 0.00, 0.00, 1, 1, 1.0432, -3.954)

The reason for this is that I need to address/ modify some of these entries later on, and it makes things easier if they are in a list or tuple.

You could potentially do something like this ...

line = "10810 'AHANE 10' 110.00 1 0.00 0.00 1 1 1.0517 -4.091"

rawlist = line.split("'")
print rawlist  # test
number = rawlist.pop(0).strip()
name = rawlist.pop(0).strip()
numbers = rawlist.pop(0).strip()
mylist = [number, name]
for n in numbers.split():
    mylist.append(n)

print mylist

You could use a combination of re and split. Find and remove all items in quotes first then split on space. Example:

import re

s = '''10471 'AGHADA71' 20.00 2 0.00 0.00 1 1 1.0106 0.312 'AGGTREW 45'
10475 'AGHADA75' 21.00 2 0.00 0.00 1 1 0.9940 -1.217
10810 'AHANE 10' 110.00 1 0.00 'AHANE 10' 'AHANE 10' 0.00 1 1 1.0517 -4.091 '''

lines = s.split('\n')

patt = re.compile(r'\'(.+?)\'')
output = []
for line in lines:
    lineList = []
    while True:
        m = patt.search(line)
        if m:
            lineList.append(m.group(1))
            line = line[:m.start()] + line[m.end()+1:]
        else:
            break
    lineList.extend([item.strip() for item in line.split() if item.strip()])
    output.append(lineList)

for item in output:
    print item

I added additional quotes to test for a general solution. The output is:

>>> ['AGHADA71', 'AGGTREW 45', '10471', '20.00', '2', '0.00', '0.00', '1', '1', '1.0106', '0.312']
['AGHADA75', '10475', '21.00', '2', '0.00', '0.00', '1', '1', '0.9940', '-1.217']
['AHANE 10', 'AHANE 10', 'AHANE 10', '10810', '110.00', '1', '0.00', '0.00', '1', '1', '1.0517', '-4.091']
>>>

The drawback is the items are not in order.

I once wrote a code snippet that parses command lines the way a C program parses argv. You could use it for your problem: save http://www.daniweb.com/code/snippet234768.html as argv.py

>>> from argv import buildargv
>>> print buildargv("10210 'ARDNA 10' 110.00 1 0.00 0.00 1 1 1.0432 -3.954"))
['10210', 'ARDNA 10', '110.00', '1', '0.00', '0.00', '1', '1', '1.0432', '-3.954']

On a command line, the rule is the same: space is preserved in single quoted or double quoted arguments.

Thanks for all your replies - I get the impression that there is no
terse one-line solution to this problem! The way I have it coded at the moment is as follows, which also deals with the case where there is no string within the data entry.

def split_strings_with_quotes(datastring):
    newstring = []
    left = ((datastring.strip()).split("'"))[0]
    right = ((datastring.strip()).split("'"))[2]
    middle = datastring.split("'")[1]
    leftelements = left.split()
    rightelements = right.split()
    for element in leftelements:
        newstring.append(element)
    
    newstring.append(middle)

    for element in rightelements:
        newstring.append(element)
    return newstring

def split_strings_no_quotes(datastring):
    newstring = []
    stringelements = (datastring.strip()).split()

    for element in stringelements:
        newstring.append(element)
    return newstring

def split_strings(datastring):
  
    if datastring.count("'") > 0:
        return(split_strings_with_quotes(datastring))
    else:
        return(split_strings_no_quotes(datastring))
This article has been dead for over six months. Start a new discussion instead.