We often need to find information from one log line based on criteria matched on another log line within the same session.
The tools might take as input:
- search pattern to select sessions
- output line pattern, to select the line with the info we want from within the selected sessions
- output selection
- delimiter and field numbers
- regex patterns
- xpath selections
Or we could bake in all sorts of recipies for selecting specific pieces of data from specific gateway logs.
Search parameters should also include start and end dates
Should have option to de-duplicate output by email address.
@awight, did we have an Etherpad going for this brainstorm once upon a time?
Use case:
We would like to use our email program to ask donors with failed payments to retry. This was tested with high success after the payment outage on 9/2/15 - the email had a 20% donation per email rate which is basically unheard of...
So we want to try this with more "normal" GC 100 failures following a Wednesday English banner test. The trouble is (per T111448) I don't know how to get the data. For the 9/2 failure, GC sent us all the order IDs, but I want to find a scalable process so that's not an option this time. Can someone teach me how to use grep to get email addresses, and ideally a few other things, for failed payments?
This is not urgent, but I would very much like to run this pilot by the end of October lest it is something I want to do regularly during Big English. Hopefully a short training session will be enough for me to manage the process alone going forward.