HTML parsing by perl

avik1983 0 Newbie Poster

17 Years Ago

i have a HTML report file..its in attachment(a part of the whole report is attached..name "input html.doc").also its source is attached in "report source code.txt"

i just want to seperate the datas like in first line it should be..

NHTEST-3848498958-NHTEST-10.2-no-baloo a
and so on for whole report

i have done that already using a perl script.its also attached ,named-"perl coding for parsing.txt"(its attached for ur help) [IMG]http://www.unix.com/images/smilies/smile.gif[/IMG]

now suppose i have more than 1 file,ie 20 report in html format.and i have to compare different values of all the tables from different report files (ie,to compare buffer cache values from different report file).

so how to do that..plss give me some ideas. [IMG]http://www.unix.com/images/smilies/confused.gif[/IMG]
i need a script to do this in unix or perl..can you help me in this regards.
waitin for ur reply

perl

This attachment is potentially unsafe to open. It may be an executable that is capable of making changes to your file system, or it may require specific software to open. Use caution and only open this attachment if you are comfortable working with msword files.

input_html.doc (74.5 KB)

perl_coding_for_parsing.txt (4.05 KB)

#!/usr/bin/perl -w

use strict;
use HTML::TokeParser;

my ($html, $token, @parsed);

{ 
	local $/;
	$html = HTML::TokeParser->new(\<DATA>);
}

while ($token = $html->get_tag('td') and $token->[1]{class} =~ /awrnc/i) {
	push @parsed, $html->get_trimmed_text('/td');
	$html->get_tag('td');
	push @parsed, $html->get_trimmed_text('/td');
}

print join("\n", @parsed, q{});

__DATA__
<HTML><HEAD><TITLE>AWR Report</TITLE><style type="text/css">body.awr {font:bold 10pt Arial,Helvetica,Geneva,sans-serif;color:black; background:White;}
pre.awr  {font:8pt Courier;color:black; background:White;}h1.awr   {font:bold 20pt Arial,Helvetica,Geneva,sans-serif;color:#336699;background-color:White;border-bottom:1px solid #cccc99;margin-top:0pt; margin-bottom:0pt;padding:0px 0px 0px 0px;}
h2.awr   {font:bold 18pt Arial,Helvetica,Geneva,sans-serif;color:#336699;background-color:White;margin-top:4pt; margin-bottom:0pt;}
h3.awr {font:bold 16pt Arial,Helvetica,Geneva,sans-serif;color:#336699;background-color:White;margin-top:4pt; margin-bottom:0pt;}li.awr {font: 8pt Arial,Helvetica,Geneva,sans-serif; color:black; background:White;}
th.awrnobg {font:bold 8pt Arial,Helvetica,Geneva,sans-serif; color:black; background:White;padding-left:4px; padding-right:4px;padding-bottom:2px}th.awrbg {font:bold 8pt Arial,Helvetica,Geneva,sans-serif; color:White; background:#0066CC;padding-left:4px; padding-right:4px;padding-bottom:2px}
td.awrnc {font:8pt Arial,Helvetica,Geneva,sans-serif;color:black;background:White;vertical-align:top;}
td.awrc    {font:8pt Arial,Helvetica,Geneva,sans-serif;color:black;background:#FFFFCC; vertical-align:top;}a.awr {font:bold 8pt Arial,Helvetica,sans-serif;color:#663300; vertical-align:top;margin-top:0pt; margin-bottom:0pt;}
</style></HEAD><BODY class='awr'>
<H1 class='awr'>
WORKLOAD REPOSITORY report for

</H1>
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrbg'>DB Name</TH><TH class='awrbg'>DB Id</TH><TH class='awrbg'>Instance</TH><TH class='awrbg'>Inst num</TH><TH class='awrbg'>Release</TH><TH class='awrbg'>RAC</TH><TH class='awrbg'>Host</TH></TR>
<TR><TD class='awrnc'>NHTEST</TD><TD ALIGN='right' class='awrnc'>3848498958</TD><TD class='awrnc'>NHTEST</TD><TD ALIGN='right' class='awrnc'>1</TD><TD class='awrnc'>10.2.0.2.0</TD><TD class='awrnc'>NO</TD><TD class='awrnc'>baloo_a</TD></TR>
</TABLE>
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrnobg'></TH><TH class='awrbg'>Snap Id</TH><TH class='awrbg'>Snap Time</TH><TH class='awrbg'>Sessions</TH><TH class='awrbg'>Cursors/Session</TH></TR>
<TR><TD class='awrnc'>Begin Snap:</TD><TD ALIGN='right' class='awrnc'>1728</TD><TD ALIGN='center' class='awrnc'>02-Feb-07 20:00:35</TD><TD ALIGN='right' class='awrnc'>20</TD><TD ALIGN='right' class='awrnc'>      3.1</TD></TR>
<TR><TD class='awrc'>End Snap:</TD><TD ALIGN='right' class='awrc'>1729</TD><TD ALIGN='center' class='awrc'>02-Feb-07 21:00:35</TD><TD ALIGN='right' class='awrc'>23</TD><TD ALIGN='right' class='awrc'>      3.7</TD></TR>
<TR><TD class='awrnc'>Elapsed:</TD><TD class='awrnc'>&nbsp;</TD><TD ALIGN='center' class='awrnc'>              60.01 (mins)</TD><TD class='awrnc'>&nbsp;</TD><TD class='awrnc'>&nbsp;</TD></TR>
<TR><TD class='awrc'>DB Time:</TD><TD class='awrc'>&nbsp;</TD><TD ALIGN='center' class='awrc'>               0.27 (mins)</TD><TD class='awrc'>&nbsp;</TD><TD class='awrc'>&nbsp;</TD></TR>
</TABLE>
<P>
<H3 class='awr'><A class='awr' NAME='99999'></A>Report Summary</H3>
<P>
Cache Sizes
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrnobg'></TH><TH class='awrbg'>Begin</TH><TH class='awrbg'>End</TH><TH class='awrnobg'></TH><TH class='awrnobg'></TH></TR>
<TR><TD class='awrnc'>Buffer Cache:</TD><TD ALIGN='right' class='awrnc'>     5,984M</TD><TD ALIGN='right' class='awrnc'>     5,984M</TD><TD class='awrnc'>Std Block Size:</TD><TD ALIGN='right' class='awrnc'>         8K</TD></TR>
<TR><TD class='awrc'>Shared Pool Size:</TD><TD ALIGN='right' class='awrc'>     1,136M</TD><TD ALIGN='right' class='awrc'>     1,136M</TD><TD class='awrc'>Log Buffer:</TD><TD ALIGN='right' class='awrc'>    14,348K</TD></TR>
</TABLE>
</BODY></HTML>

report_source_code.txt (9.44 KB)

<HTML><HEAD><TITLE>AWR Report</TITLE><style type="text/css">body.awr {font:bold 10pt Arial,Helvetica,Geneva,sans-serif;color:black; background:White;}
pre.awr  {font:8pt Courier;color:black; background:White;}h1.awr   {font:bold 20pt Arial,Helvetica,Geneva,sans-serif;color:#336699;background-color:White;border-bottom:1px solid #cccc99;margin-top:0pt; margin-bottom:0pt;padding:0px 0px 0px 0px;}
h2.awr   {font:bold 18pt Arial,Helvetica,Geneva,sans-serif;color:#336699;background-color:White;margin-top:4pt; margin-bottom:0pt;}
h3.awr {font:bold 16pt Arial,Helvetica,Geneva,sans-serif;color:#336699;background-color:White;margin-top:4pt; margin-bottom:0pt;}li.awr {font: 8pt Arial,Helvetica,Geneva,sans-serif; color:black; background:White;}
th.awrnobg {font:bold 8pt Arial,Helvetica,Geneva,sans-serif; color:black; background:White;padding-left:4px; padding-right:4px;padding-bottom:2px}th.awrbg {font:bold 8pt Arial,Helvetica,Geneva,sans-serif; color:White; background:#0066CC;padding-left:4px; padding-right:4px;padding-bottom:2px}
td.awrnc {font:8pt Arial,Helvetica,Geneva,sans-serif;color:black;background:White;vertical-align:top;}
td.awrc    {font:8pt Arial,Helvetica,Geneva,sans-serif;color:black;background:#FFFFCC; vertical-align:top;}a.awr {font:bold 8pt Arial,Helvetica,sans-serif;color:#663300; vertical-align:top;margin-top:0pt; margin-bottom:0pt;}
</style></HEAD><BODY class='awr'>
<H1 class='awr'>
WORKLOAD REPOSITORY report for

</H1>
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrbg'>DB Name</TH><TH class='awrbg'>DB Id</TH><TH class='awrbg'>Instance</TH><TH class='awrbg'>Inst num</TH><TH class='awrbg'>Release</TH><TH class='awrbg'>RAC</TH><TH class='awrbg'>Host</TH></TR>
<TR><TD class='awrnc'>NHTEST</TD><TD ALIGN='right' class='awrnc'>3848498958</TD><TD class='awrnc'>NHTEST</TD><TD ALIGN='right' class='awrnc'>1</TD><TD class='awrnc'>10.2.0.2.0</TD><TD class='awrnc'>NO</TD><TD class='awrnc'>baloo_a</TD></TR>
</TABLE>
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrnobg'></TH><TH class='awrbg'>Snap Id</TH><TH class='awrbg'>Snap Time</TH><TH class='awrbg'>Sessions</TH><TH class='awrbg'>Cursors/Session</TH></TR>
<TR><TD class='awrnc'>Begin Snap:</TD><TD ALIGN='right' class='awrnc'>1728</TD><TD ALIGN='center' class='awrnc'>02-Feb-07 20:00:35</TD><TD ALIGN='right' class='awrnc'>20</TD><TD ALIGN='right' class='awrnc'>      3.1</TD></TR>
<TR><TD class='awrc'>End Snap:</TD><TD ALIGN='right' class='awrc'>1729</TD><TD ALIGN='center' class='awrc'>02-Feb-07 21:00:35</TD><TD ALIGN='right' class='awrc'>23</TD><TD ALIGN='right' class='awrc'>      3.7</TD></TR>
<TR><TD class='awrnc'>Elapsed:</TD><TD class='awrnc'>&nbsp;</TD><TD ALIGN='center' class='awrnc'>              60.01 (mins)</TD><TD class='awrnc'>&nbsp;</TD><TD class='awrnc'>&nbsp;</TD></TR>
<TR><TD class='awrc'>DB Time:</TD><TD class='awrc'>&nbsp;</TD><TD ALIGN='center' class='awrc'>               0.27 (mins)</TD><TD class='awrc'>&nbsp;</TD><TD class='awrc'>&nbsp;</TD></TR>
</TABLE>
<P>
<H3 class='awr'><A class='awr' NAME='99999'></A>Report Summary</H3>
<P>
Cache Sizes
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrnobg'></TH><TH class='awrbg'>Begin</TH><TH class='awrbg'>End</TH><TH class='awrnobg'></TH><TH class='awrnobg'></TH></TR>
<TR><TD class='awrnc'>Buffer Cache:</TD><TD ALIGN='right' class='awrnc'>     5,984M</TD><TD ALIGN='right' class='awrnc'>     5,984M</TD><TD class='awrnc'>Std Block Size:</TD><TD ALIGN='right' class='awrnc'>         8K</TD></TR>
<TR><TD class='awrc'>Shared Pool Size:</TD><TD ALIGN='right' class='awrc'>     1,136M</TD><TD ALIGN='right' class='awrc'>     1,136M</TD><TD class='awrc'>Log Buffer:</TD><TD ALIGN='right' class='awrc'>    14,348K</TD></TR>
</TABLE>
<P>Load Profile<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrnobg'></TH><TH class='awrbg'>Per Second</TH><TH class='awrbg'>Per Transaction</TH></TR>
<TR><TD class='awrnc'>Redo size:</TD><TD ALIGN='right' class='awrnc'>               182.38</TD><TD ALIGN='right' class='awrnc'>            82,087.50</TD></TR>
<TR><TD class='awrc'>Logical reads:</TD><TD ALIGN='right' class='awrc'>                 6.80</TD><TD ALIGN='right' class='awrc'>             3,062.50</TD></TR>
<TR><TD class='awrnc'>Block changes:</TD><TD ALIGN='right' class='awrnc'>                 0.46</TD><TD ALIGN='right' class='awrnc'>               207.75</TD></TR>
<TR><TD class='awrc'>Physical reads:</TD><TD ALIGN='right' class='awrc'>                 0.00</TD><TD ALIGN='right' class='awrc'>                 0.63</TD></TR>
<TR><TD class='awrnc'>Physical writes:</TD><TD ALIGN='right' class='awrnc'>                 0.12</TD><TD ALIGN='right' class='awrnc'>                52.50</TD></TR>
<TR><TD class='awrc'>User calls:</TD><TD ALIGN='right' class='awrc'>                 0.90</TD><TD ALIGN='right' class='awrc'>               404.50</TD></TR>
<TR><TD class='awrnc'>Parses:</TD><TD ALIGN='right' class='awrnc'>                 0.43</TD><TD ALIGN='right' class='awrnc'>               191.63</TD></TR>
<TR><TD class='awrc'>Hard parses:</TD><TD ALIGN='right' class='awrc'>                 0.00</TD><TD ALIGN='right' class='awrc'>                 0.25</TD></TR>
<TR><TD class='awrnc'>Sorts:</TD><TD ALIGN='right' class='awrnc'>                 0.63</TD><TD ALIGN='right' class='awrnc'>               285.38</TD></TR>
<TR><TD class='awrc'>Logons:</TD><TD ALIGN='right' class='awrc'>                 0.01</TD><TD ALIGN='right' class='awrc'>                 4.63</TD></TR>
<TR><TD class='awrnc'>Executes:</TD><TD ALIGN='right' class='awrnc'>                 1.05</TD><TD ALIGN='right' class='awrnc'>               472.38</TD></TR>
<TR><TD class='awrc'>Transactions:</TD><TD ALIGN='right' class='awrc'>                 0.00</TD><TD class='awrc'>&nbsp;</TD></TR>
</TABLE>
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TD class='awrnc'>% Blocks changed per Read:</TD><TD ALIGN='right' class='awrnc'>   6.78</TD><TD class='awrnc'>Recursive Call %:</TD><TD ALIGN='right' class='awrnc'>   85.88</TD></TR>
<TR><TD class='awrc'>Rollback per transaction %:</TD><TD ALIGN='right' class='awrc'>   0.00</TD><TD class='awrc'>Rows per Sort:</TD><TD ALIGN='right' class='awrc'>   16.39</TD></TR>
</TABLE>
<P>
Instance Efficiency Percentages (Target 100%)
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TD class='awrc'>Buffer Nowait %:</TD><TD ALIGN='right' class='awrc'>           100.00</TD><TD class='awrc'>Redo NoWait %:</TD><TD ALIGN='right' class='awrc'>           100.00</TD></TR>
<TR><TD class='awrnc'>Buffer  Hit   %:</TD><TD ALIGN='right' class='awrnc'>            99.98</TD><TD class='awrnc'>In-memory Sort %:</TD><TD ALIGN='right' class='awrnc'>           100.00</TD></TR>
<TR><TD class='awrc'>Library Hit   %:</TD><TD ALIGN='right' class='awrc'>            99.91</TD><TD class='awrc'>Soft Parse %:</TD><TD ALIGN='right' class='awrc'>            99.87</TD></TR>
<TR><TD class='awrnc'>Execute to Parse %:</TD><TD ALIGN='right' class='awrnc'>            59.43</TD><TD class='awrnc'>Latch Hit %:</TD><TD ALIGN='right' class='awrnc'>           100.00</TD></TR>
<TR><TD class='awrc'>Parse CPU to Parse Elapsd %:</TD><TD ALIGN='right' class='awrc'>             0.00</TD><TD class='awrc'>% Non-Parse CPU:</TD><TD ALIGN='right' class='awrc'>           100.00</TD></TR>
</TABLE>
<P>
Shared Pool Statistics
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrnobg'></TH><TH class='awrbg'>Begin</TH><TH class='awrbg'>End</TH></TR>
<TR><TD class='awrnc'>Memory Usage %:</TD><TD ALIGN='right' class='awrnc'>            25.76</TD><TD ALIGN='right' class='awrnc'>            25.77</TD></TR>
<TR><TD class='awrc'>% SQL with executions>1:</TD><TD ALIGN='right' class='awrc'>            93.09</TD><TD ALIGN='right' class='awrc'>            91.59</TD></TR>
<TR><TD class='awrnc'>% Memory for SQL w/exec>1:</TD><TD ALIGN='right' class='awrnc'>            91.26</TD><TD ALIGN='right' class='awrnc'>            90.03</TD></TR>
</TABLE>
<P>
Top 5 Timed Events
<P>
<TABLE BORDER=1 WIDTH=500>
<TR><TH class='awrbg'>Event</TH><TH class='awrbg'>Waits</TH><TH class='awrbg'>Time(s)</TH><TH class='awrbg'>Avg Wait(ms)</TH><TH class='awrbg'>% Total Call Time</TH><TH class='awrbg'>Wait Class</TH></TR>
<TR><TD class='awrnc'>control file sequential read</TD><TD ALIGN='right' class='awrnc'>          10,956</TD><TD ALIGN='right' class='awrnc'>               9</TD><TD ALIGN='right' class='awrnc'>               1</TD><TD ALIGN='right' class='awrnc'>            55.3</TD><TD class='awrnc'>System I/O</TD></TR>
<TR><TD class='awrc'>CPU time</TD><TD ALIGN='right' class='awrc'>&nbsp;</TD><TD ALIGN='right' class='awrc'>               4</TD><TD ALIGN='right' class='awrc'>&nbsp;</TD><TD ALIGN='right' class='awrc'>            23.9</TD><TD class='awrc'>&nbsp;</TD></TR>
<TR><TD class='awrnc'>control file parallel write</TD><TD ALIGN='right' class='awrnc'>           1,342</TD><TD ALIGN='right' class='awrnc'>               3</TD><TD ALIGN='right' class='awrnc'>               3</TD><TD ALIGN='right' class='awrnc'>            20.8</TD><TD class='awrnc'>System I/O</TD></TR>
<TR><TD class='awrc'>switch logfile command</TD><TD ALIGN='right' class='awrc'>               2</TD><TD ALIGN='right' class='awrc'>               3</TD><TD ALIGN='right' class='awrc'>           1,622</TD><TD ALIGN='right' class='awrc'>            19.7</TD><TD class='awrc'>Administrative</TD></TR>
<TR><TD class='awrnc'>db file sequential read</TD><TD ALIGN='right' class='awrnc'>             126</TD><TD ALIGN='right' class='awrnc'>               1</TD><TD ALIGN='right' class='awrnc'>               9</TD><TD ALIGN='right' class='awrnc'>             7.1</TD><TD class='awrnc'>User I/O</TD></TR>
</TABLE>

1 Contributor
0 Replies
47 Views

Be the first to reply

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.