osx - search and remove string with variable parameters -


i need remove strings text file using command line on osx.

the string have permanent features have arbitrary digits.

i want remove every variant of :-

            [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]     

this string has varying values want remove leaving relevant information in sections labled:-

 pattern1 :  code :  codehash :  result : 

the following mock procedure needs happen

 each line{ if string contains [%d%d%d.%d%d kkey/s][total %d%d%d%d%d%d%d][prob %d.%d%][%d%d% in %d.%dh]  (where "%d" decimal value){  delete string , line  } else if !contains {   move down 1 line. } { 

with below text patterns , hashes should saved text document

            [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]                pattern1: want keep text after pattern , code until next line of processing including hash             code : aksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsd              codehash : e3287cb701f336a628885e66d17e38f2              result : d0b6789d4e0acf39a8c24b424c0060ffff2da857                [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]              pattern2: want keep text after pattern , code until next line of processing including hash             code : qwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrq              codehash : 05bfabd43ff6c85a8fa2d3347d828c4b              result : 165b6ca902e567959c9bb599fabeb3998b21e31f               [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h]             [370.15 kkey/s][total 2999999][prob 0.0%][50% in 7.8h]             [370.02 kkey/s][total 3000368][prob 0.0%][50% in 7.8h]             [323.02 kkey/s][total 3001368][prob 0.0%][50% in 7.8h]             [389.02 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [379.06 kkey/s][total 3003368][prob 0.0%][50% in 7.8h]             [300.01 kkey/s][total 3004368][prob 0.0%][50% in 7.8h]             [379.02 kkey/s][total 3005368][prob 0.0%][50% in 7.8h]             [279.02 kkey/s][total 3006368][prob 0.0%][50% in 7.8h]             [179.02 kkey/s][total 3007898][prob 0.0%][50% in 7.8h] 

leaving resulting text document this:-

            pattern1 : want keep text after pattern , code until next line of processing including hash             code : aksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsdaksjhdakjsdhakshdkasdhkashkjahsd             codehash : e3287cb701f336a628885e66d17e38f2             result : d0b6789d4e0acf39a8c24b424c0060ffff2da857             pattern2 : want keep text after pattern , code until next line of processing including hash             code : qwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrqgfqwfufiyfoqywfofqwytrq             codehash: 05bfabd43ff6c85a8fa2d3347d828c4b             result : 165b6ca902e567959c9bb599fabeb3998b21e31f 

i have used sed remove single characters so:-

 sed -i '' 's/%/\ /g' file.txt   sed -i '' 's/\[/\ /g' file.txt  sed -i '' 's/]/\ /g' file.txt  sed -i '' 's/kkey\/s/\ /g' file.txt 

while works symbols cant guess numbers or sed out numbers incase within the important strings , sed replaces it!

with above routine in mind how approach this??

many in advance can offer

you can use grep -v:

grep -v 'kkey/s.*total.*prob' < input > output 

or if want remove blank lines too:

egrep '^[ \t]*(pattern1|code|codehash|result) : ' < input > output 

Comments

Popular posts from this blog

html - Outlook 2010 Anchor (url/address/link) -

javascript - Why does running this loop 9 times take 100x longer than running it 8 times? -

Getting gateway time-out Rails app with Nginx + Puma running on Digital Ocean -