Ad:

C++ Discussion Thread
Marked Solved
Views: 11424

Jun 16th, 2007

Splitting words from string into character array

Expand Post »

So Im trying to write some code that takes a chunk of text, splits it up into words, then puts these words into an array. What I have is:

C++ Syntax (Toggle Plain Text)
string buf;
stringstream ss(database); // database is my chunk of text
 
 
    while (ss >> buf) // Tokenize when whitespace met
    {
          ???
    }
string buf;
stringstream ss(database); // database is my chunk of text

    
    while (ss >> buf) // Tokenize when whitespace met
    {
          ???
    }

So in that while loop I want to take the string "buf" and put it into an array. Thus the result is an array of strings containing every word in the paragraph. This is where I feel like an idiot.

I have tried a few ways using string streams and converting strings to char arrays etc, but nothing will work for me. I have a feeling that this has to do with multidimensional arrays and pointers, but my searches have been fruitless.

Thanks in advance!

Similar Threads

Copying words into an array of char ?!? in C
How to work with digits when they are characters in a string in C
How to flip bits in C
Character Array to character pointer. in C
String class help in Java

hbweb500

Reputation Points: 10

Solved Threads: 0

Newbie Poster

Offline

6 posts
since Feb 2005

Permalink

Jun 16th, 2007

Re: Splitting words from string into character array

My advice, use the vector container. One of the advantages of using C++.

bumsfeld

Reputation Points: 404

Solved Threads: 180

Nearly a Posting Virtuoso

Offline

1,422 posts
since Jul 2005

Permalink

Jun 16th, 2007

Re: Splitting words from string into character array

C++ Syntax (Toggle Plain Text)
#include <vector>
#include <boost/tokenizer.hpp>
#include <string>
#include <vector>
#include <iostream>
using namespace std;
using namespace boost;
 
int main()
{
  string str = "The boost tokenizer library provides a flexible "
                       "and easy to use way to break of a string or other "
                       "character sequence into a series of tokens.\n"
                       "Here is a simple example that will break up a "
                       "paragraph into words.\n";
  tokenizer<> toker( str );
  vector<string> words( toker.begin(), toker.end() ) ;
  cout << "there are " << words.size() << " words\n" ;
  cout << "words[6]: " << words[6] << '\n' ;
}
#include <vector>
#include <boost/tokenizer.hpp>
#include <string>
#include <vector>
#include <iostream>
using namespace std;
using namespace boost;

int main()
{
  string str = "The boost tokenizer library provides a flexible "
                       "and easy to use way to break of a string or other "
                       "character sequence into a series of tokens.\n"
                       "Here is a simple example that will break up a "
                       "paragraph into words.\n";
  tokenizer<> toker( str );
  vector<string> words( toker.begin(), toker.end() ) ;
  cout << "there are " << words.size() << " words\n" ;
  cout << "words[6]: " << words[6] << '\n' ;
}

Last edited by vijayan121; Jun 16th, 2007 at 11:29 pm.

vijayan121

Reputation Points: 1159

Solved Threads: 285

Posting Virtuoso

Offline

1,606 posts
since Dec 2006

Permalink

Jun 17th, 2007

Re: Splitting words from string into character array

What also complicates matters is if your words are separated by more than one space, or even tabs.

In that case, it would probably be wiser to use regular expressions. The task becomes almost trivial.

iamthwee

Featured Poster

Reputation Points: 1536

Solved Threads: 431

Posting Expert

Offline

5,865 posts
since Aug 2005

Permalink

Jun 18th, 2007

Re: Splitting words from string into character array

This is perfect, vijayan, thanks a bunch!

hbweb500

Reputation Points: 10

Solved Threads: 0

Newbie Poster

Offline

6 posts
since Feb 2005

This thread is solved

Either the thread starter or a moderator has marked this thread as solved. You can most likely trust the responses and answers given. There is most likely no reason for any further responses to be posted here. If you have a related question, please start a new thread in this forum instead.

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.

Previous Thread in C++ Forum Timeline: Linked lists

Next Thread in C++ Forum Timeline: database and form security

DaniWeb Message

Cancel Changes

User Name
Password