Linux – Script for search string inside the file for every one hour

awkbashlinuxshell-scripting

I need to write a script where the particular string(alphanumeric) should be searched inside the file with every hour for whole day. And the search should not contain the previous hour results.

Time stamp format inside file is "2014-02-17 17:00:01"

The below command will give the out put for the whole day count but i need every hour count.

grep "recFileChg:true" *.tmp | awk -F "|" '{print $4, $29}' | cut -d "," -f1,2 | awk -F "[" '{print $1, $2}'

I would be very much appreciated if somebody can help me on this.

Best Answer

Well, it would be nice to have a line you have and a line you would like to get as the search result.

Anyway, I think it can be solved with just grep and cut:

grep "recFileChg:true" *.tmp | cut -f2- -d':' | cut -f2 -d'[' | cut -f1 -d':'

the first cut will strip the file name from the grep output
the second cut will strip everything up to the '[' character
the last cut will cut out the date and the hour

Related Solutions

Linux – What command can I use to search sendmail logs for ALL message details involving a specific recipient.

You could do something similar to this.

for i in `grep -i "someuser@recipientdomain.com" /var/log/maillog | awk '{print $5}'`; do grep -i $i /var/log/maillog; done

This will grep out the line for the user you are looking for, then select the 5th item on the line (seperated by spaces iirc). Then for each message ID in that list, will then grep for the lines containing the message ID's.

If you want to remove the : from the end of the message ID, you can do something like for i in grep -i "someuser@recipientdomain.com" /var/log/maillog | awk '{print $5}' | sed 's/\://; do grep -i $i /var/log/maillog; done

Hope that helps.

Bash sub-string extraction for specified start and end character

I think this will split the line as you want

sed -e 's/\]/\]\n/g' log | sed -e 's/^ *//g' | awk '/^\[/ {print}'

First put a newline after each ] then remove any leading spaces and finally print the lines beginning with [.

Your input line becomes

[Wed Aug 08 11:39:41 2012]
[error]
[client 155.94.70.224]
[line "271"]
[id "960020"]
[rev "2.2.5"]
[msg "Pragma Header requires Cache-Control Header for HTTP/1.1 requests."]
[severity "NOTICE"]
[tag "RULE_MATURITY/5"]
[tag "RULE_ACCURACY/7"]
[tag "https://www.owasp.org/index.php/ModSecurity_CRS_RuleID-960020"]
[tag "PROTOCOL_VIOLATION/INVALID_HREQ"]
[tag "http://www.bad-behavior.ioerror.us/documentation/how-it-works/"]
[uri "/horde/themes/graphics/tree/plusonly.png"]
[unique_id "UCJB7VveCGYAAG@BHJgAAAAQ"]

Best Answer

Related Solutions

Linux – What command can I use to search sendmail logs for ALL message details involving a specific recipient.

Bash sub-string extraction for specified start and end character

Related Topic