bash - Processing multi line logs with AWK to gather SQL statements -

-

i have following entries in log file: 

2016-01-25 21:12:41 utc:172.31.21.125(56665):user@production:[21439]:error:  bind message supplies 1 parameters, prepared statement "" requires 0  2016-01-25 21:12:41 utc:172.31.21.125(56665):user@production:[21439]:statement:  select count(*) total (                 select 1 count                   leads_search_criteria_entities                   inner join entities e on entity_id = e.viq_id                   left join companies_user cu on cu.entity_id = e.viq_id                   criterium_id = 644 , ((                 ( cu.udef_type null -- if not set user, check calculated value                   , is_university >= 50                 ) or (                   cu.udef_type not null -- if set user, use                   , cu.udef_type = 'university'                 )               ))                   group e.viq_id                    order e.viq_id                 ) x 2016-01-25 21:14:11 utc::@:[2782]:log:  checkpoint starting: time 2016-01-25 21:14:16 utc::@:[2782]:log:  checkpoint complete: wrote 51 buffers (0.0%); 0 transaction log file(s) added, 0 remov ed, 0 recycled; write=5.046 s, sync=0.038 s, total=5.091 s; sync files=18, longest=0.008 s, average=0.002 s 2016-01-25 21:19:11 utc::@:[2782]:log:  checkpoint starting: time

i capture sql statements not sure how can awk.

update:

expected outcome:

select count(*) total ( select 1 count leads_search_criteria_entities inner join entities e on entity_id = e.viq_id left join companies_user cu on cu.entity_id = e.viq_id criterium_id = 644 , (( ( cu.udef_type null -- if not set user, check calculated value , is_university >= 50 ) or ( cu.udef_type not null -- if set user, use , cu.udef_type = 'university' ) )) group e.viq_id order e.viq_id ) x

my current working solution uses sed got stuck, helps filtering lines have select (multiple lines itself) , next line after that. suggestion appreciated 

sed -n "/:statement:/,/2016/p" out

i don't recommend using sed this. first thought awk solution might this:

/^2016/&&line~/:statement:/ {   sub(/.*:statement:/,"",line)   print line } /^2016/ {   line="" } {   $1=$1   line=sprintf("%s %s",line,$0) } end {   if (line~/:statement:/) {     sub(/.*:statement:/,"",line)     print line   } }

obviously shrink this. wrote , ran (for testing) one-liner.

the idea here that:

  • we'll append variable, resetting every time our input line starts year. (you replace regexp matching date if want run next year without modification),
  • when new log line (or end), strip off cruft before sql statement , print result.

note $1=$1. purpose of change line's whitespace, newlines , tabs , multiples spaces collapsed single spaces. experiment removing see impact.


Comments

Post a Comment

Popular posts from this blog

Hatching array of circles in AutoCAD using c# -

-
i beginner in autocad plugins .i have created array of circle using following code. now, have hatch circles in array .how that??how hatch circles @ once? moreover, how can return hatch method , use hatch objects.sorry language.thanks in advance. [assembly: commandclass(typeof(beamsection.class1))] namespace beamsection { public class class1 { //class1 obj = new class1(); [commandmethod("beamatsupport")] public void addlightweightpolyline() { // current document , database document acdoc = application.documentmanager.mdiactivedocument; database accurdb = acdoc.database; promptpointresult ppr = acdoc.editor.getpoint("\nselect starting point "); var ucs = acdoc.editor.currentusercoordinatesystem; point3d startingpt = ppr.value.transformby(ucs); list<double> radius = new list<double>(); radius.add(0.5);
Read more

ios - UITEXTFIELD InputView Uipicker not working in swift -

-
hello trying pop uipickerview view programmatically when user clicks on textfield. have tried doesn't doing anything. isn't working. nothing happening when click textfield class userprofiletableviewcontroller: uitableviewcontroller,uitextfielddelegate,uipickerviewdelegate,uipickerviewdatasource { var itempicker: uipickerview! = uipickerview() @iboutlet weak var gendertxtfield: uitextfield! var gender = ["male","female"] override func viewdidload() { super.viewdidload() gendertxtfield.delegate = self itempicker!.delegate = self itempicker!.datasource = self itempicker!.backgroundcolor = uicolor.blackcolor() self.gendertxtfield.inputview = itempicker } func numberofcomponentsinpickerview(pickerview: uipickerview) -> int{ return 1 } // returns # of rows in each component.. func pickerview(pickerview: uipickerview, numberofrowsincomponent component:
Read more

Python Pig Latin Translator -

-
so have been working on @ codecademy.com while trying learn python. don't know if blind , can't see why won't work or what. here's code won't let me use. function print variable if had typed in , print "empty" if didn't type anything. print "welcome english pig latin translator!" original = raw_input("what's name?") if len(original) > 0 print original else print "empty" if len(original) > 0 else the above lines contains syntax errors. try: if len(original) > 0: else: note added colons, ( : ).
Read more