Shell Scripting

Shell Scripting RSS

Shell script to read lines in a text file and filter user data

Thread Solved

•

Join Date: Aug 2008

Posts: 2

Reputation: e04047 is an unknown quantity at this point

Solved Threads: 0

e04047

Offline

Newbie Poster

Shell script to read lines in a text file and filter user data

Oct 21st, 2009

hi all,

I have this file [myfile.txt] with some user data.

example:
$cat myfile.txt
FName|LName|Gender|Company|Branch|Bday|Salary|Age
aaaa|bbbb|male|cccc|dddd|19900814|15000|20|
eeee|asdg|male|gggg|ksgu|19911216|||
aara|bdbm|male|kkkk|acke|19931018||23|
asad|kfjg|male|kkkc|gkgg|19921213|14000|24|
aera|bprb|male|cccc|pppp||15000|20|
.
.
. // and so on

So what I want to do is to take out (to a file) the missing fields as following format:

<FName> <LName> <Company> Missing Field/s:<> <>

example output:

eeee asdg gggg Missing Field/s: Salary Age
aara bdbm kkkk Missing Field/s: Salary

CAN ANYONE HELP ME PLEASE !!!!!!!!!!!!!!!

•

Join Date: Feb 2009

Posts: 3,187

Reputation: sknake has much to be proud of

Solved Threads: 571

sknake

Offline

.NET Enthusiast

Oct 21st, 2009

Here is a start to your solution.

 Help with Code Tags 
 Shell Scripting Syntax (Toggle Plain Text) 
#!/bin/bash
 
filename="/home/sk/daniweb/scripts/data.txt"
exec<${filename}
value=0
declare -a arr
while read line
do
 varray=(`echo $line | awk '{ split($0, ulist, "|"); for(i=1; i<=11; i++) printf ulist[i] " "; }'`)
 echo "Array Length: " ${#varray[@]}
done
#!/bin/bash

filename="/home/sk/daniweb/scripts/data.txt"
exec<${filename}
value=0
declare -a arr
while read line
do
 varray=(`echo $line | awk '{ split($0, ulist, "|"); for(i=1; i<=11; i++) printf ulist[i] " "; }'`)
 echo "Array Length: " ${#varray[@]}
done

That will read the input from your file in to an array inside of bash. Now you need to find the empty values and pull the header information.

Scott Knake
Custom Software Development
Apex Software, Inc.

•

Join Date: Aug 2008

Posts: 2

Reputation: e04047 is an unknown quantity at this point

Solved Threads: 0

e04047

Offline

Newbie Poster

FYI

Oct 21st, 2009

hi all,
I found the answer.Go through the link
==========================================
http://www.linuxquestions.org/questi...r-data-763384/
===========================================

•

Originally Posted by e04047

hi all,

I have this file [myfile.txt] with some user data.

example:
$cat myfile.txt
FName|LName|Gender|Company|Branch|Bday|Salary|Age
aaaa|bbbb|male|cccc|dddd|19900814|15000|20|
eeee|asdg|male|gggg|ksgu|19911216|||
aara|bdbm|male|kkkk|acke|19931018||23|
asad|kfjg|male|kkkc|gkgg|19921213|14000|24|
aera|bprb|male|cccc|pppp||15000|20|
.
.
. // and so on

So what I want to do is to take out (to a file) the missing fields as following format:

<FName> <LName> <Company> Missing Field/s:<> <>

example output:

eeee asdg gggg Missing Field/s: Salary Age
aara bdbm kkkk Missing Field/s: Salary

CAN ANYONE HELP ME PLEASE !!!!!!!!!!!!!!!