Bash help requested: Capturing command errors within pipes
Daniel B. Thurman
dant at cdkkt.com
Sat Mar 21 03:09:39 UTC 2009
Cameron Simpson wrote:
> On 19Mar2009 18:55, Daniel B. Thurman <dant at cdkkt.com> wrote:
>
>> Cameron Simpson wrote:
>>
>>> Ok, but I strongly recommend you never us a regexp unquoted - the
>>> necessary backslash nesting gets nasty real fast. A better way is like
>>> this:
>>> re='s/b/h/'
>>> sed -e "$re"
>>>
> [...]
>
>>> The point here, unrelated to the pipe exit status issue, is to keep the
>>> sed stuff easy to write and undamaged by shell substitution. [...]
>>>
>> Another person sent me private email
>> warning of the double-quotes, but thanks
>> for your information, it is interesting!
>>
>> This is what I ended up doing, so please give
>> your constructive critiques, if you so like?
>>
>
> Untested, but here is how I would write each of you code pieces were I doing
> it myself:
>
>
>> TRACKER="Tracker.log"
>> SFILE="Bad_Hosts_File.txt"
>> TFILE="Bad_Hosts_File_$$.txt"
>>
>
> tracker=Tracker.log
> sfile=Bad_Hosts_File.txt
> tfile=Bad_Hosts_File_$$.txt
>
> Your quotes are unneeded here. Plenty of people find the "" marks and in
> similar cases, to use ${foo} instead of $foo elsewhere, but I find the
> syntactic noise annoying if there's no other necessity.
>
> Also, you should never use UPPER CASE names for script local variables (i.e.
> that are not to be exported). I give some background why here:
>
> http://markmail.org/message/awimhb3nmu6ssvwp
>
>
>> pat="EACC"
>>
>
> pat=EACC
>
>
>> re1="-e '/$pat/s/^.*Received:\[from\s\+\(.*\)\s\+(.*/\1/'"
>> re2="-e '/^.*cdkkt.com$/d'"
>>
>
> Note that this "$" should probably be backslashed. As it happens, $/ is
> not a shell special variable, so it is left alone. However, has you used
> $# or one of the others ($!, et al) there would have been substitution
> done, mangling your sed code.
>
>
>> rex="sed $re1 $re2"
>>
>
> I would strongly reommend putting this in a sed script file, perhaps
> like this:
>
> cat >sedf$$ <<X
> /$pat/s/^.*Received:\[from\s\+\(.*\)\s\+(.*/\1/
> /^.*cdkkt.com\$/d
> X
> rex="sed -f sedf$$"
>
> Hmm, actually, maybe not. Maybe like this:
>
> sedline="/$pat/s/^.*Received:\[from\s\+\(.*\)\s\+(.*/\1/; /^.*cdkkt.com\$/d"
>
> and then:
>
> sed -e "$sedline"
>
> in your pipeline lower down.
>
>
>> echo -en "\033[0;36m>> \033[0;35mExtracting data from:\n \
>> [\033[0;34m${TRACKER}\033[0;35m and appending to\n \
>> [\033[0;34m${TFILE}\033[0;35m]\033[0m"
>>
>
> I usually put escape sequences into their own variables for readbility,
> like this:
>
> http://www.cskk.ezoshosting.com/cs/rc/shell/colour_ansi
>
> Then you can talk about ${tty_green}, ${tty_normal} etc in your text;
> somewhat more readable. You can do even better than this, actually.
> Since not all terminals use the ANSI colour escapes, it is better to use
> tput, like this:
>
> http://www.cskk.ezoshosting.com/cs/css/bin/with-colour
>
> and then in your script:
>
> esc_tracker=`with-colour green echo "$TRACKER"`
>
> and then use ${esc_tracker} in messages. And so forth.
>
>
>> out=$(grep "$pat" "${TRACKER}" | \
>> eval "$rex" | sort -n | \
>> uniq >> "${TFILE}"); ret="$?";
>>
>> if [ "$ret" -gt 0 ] || \
>> [ "$PIPESTATUS[0]" -gt 0 ] || \
>> [ "$PIPESTATUS[1]" -gt 0 ] || \
>> [ "$PIPESTATUS[2]" -gt 0 ] || \
>> [ "$PIPESTATUS[3]" -gt 0 ]; then
>> echo -e " \033[0;31mFailed.\n \
>> \033[0;35m-- ErrorStatus:<ret=$ret>,\
>> PipeStatus:<$PIPESTATUS[@]>\n\
>> -- out:<$out>\033[0m"
>> echo -e "\033[0;31m>> \033[0;31m$PROG exited.\033[0m\n"
>> exit 1
>> fi
>> echo -e " \033[0;32mDone.\033[0m";
>>
>> I guess the ugly part is the multiple $PIPESTATUS[n]
>> in the if statement test block. but perhaps this is the best
>> I can do?
>>
>
> Nah. You can do this:
>
> if out=$(grep "$pat" "$tracker" | $rex | sort -un >>"$tfile")
> then
> case " $PIPESTATUS" in
> *' '[1-9]*)
> echo exit ok, but PIPESTATUS=$PIPESTATUS
> ;;
> *)echo exit ok and PIPESTATUS all zeroes
> ;;
> esac
> else
> echo exit not ok
> fi
>
> Um, you are aware that $out will always be empty? You have sent
> standard out to the temp file. Standard error is not collected by back
> ticks or $(); it will be displayed directly and not land in $out.
> You probably need to go:
>
> out=$(exec 2>&1; grep .... >>"$tfile")
>
> An easy test is like this:
>
> out=$(ls /no/such/file >>temp)
> echo "out=[$out]"
>
> versus:
>
> out=$(exec 2>&1; ls /no/such/file >>temp)
> echo "out=[$out]"
>
> Cheers,
>
Thanks a LOT! I have updated my code following your
recommendations! Guys like you are sure a help!
It sure was an eye-opener for me when it comes to
assigning variables with double-quotes. I thought
it was needed, but little did I know!
Thanks for the education, it is appreciated!
Dan
More information about the users
mailing list