sed - remove nul lines from file

JD jd1008 at gmail.com
Tue Nov 7 18:54:06 UTC 2017



On 11/07/2017 11:46 AM, James B. Byrne via freebsd-questions wrote:
> On Tue, November 7, 2017 13:28, Yuri Pankov wrote:
>> On Tue, 7 Nov 2017 21:20:40 +0300, Yuri Pankov wrote:
>>> On Tue, 7 Nov 2017 13:14:08 -0500, James B  Byrne Via
>>> Freebsd-questions
>>> wrote:
>>>> On Tue, November 7, 2017 13:03, Yuri Pankov wrote:
>>>>
>>>>> You want /d, not /g, to delete the *lines* which contain NUL
>>>>> symbols
>>>>> (that's what your subject line said).
>>>>>
>>>> Sigh.  Thank you.  That works.  However, it also deletes any line
>>>> that
>>>> has even one NUL in it regardless of the presence of other non-nul
>>>> characters on the line.
>>>>
>>>> What I wish to accomplish is to delete only the lines that are
>>>> completely nul.  I thought that this could be accomplished by
>>>> prefacing the match sting with the start of line anchor ^ and
>>>> ending
>>>> it with the end of line anchor $ but this does not work as I
>>>> expect.
>>> "[[.NUL.]]" is just a character specified by its collation name, so
>>> treat as any other ordinary character:
>>>
>>> sed -E '/^[[.NUL.]]+$/d' INFILE > OUTFILE
>>>
>>> Need extended regexp here for '+' to work.
>>
>> Or, after looking at re_format(7), it could be written using BREs,
>> your
>> choice :-)
>>
>> sed '/^[[.NUL.]]\{1,\}$/d'
>>
> sed '/^[[.NUL.]]\{0,\}$/d' INFILE > OUTFILE
>
> Which has no effect.  OUTFILE and INFILE remain identical.  I get the
> exact same result from the first invocation as well.  Likewise:
>
> sed '/^[[.NUL.]]\{1,\}$/d' INFILE > OUTFILE
>
> and
>
> sed -E '/^[[.NUL.]]+$/d' INFILE > OUTFILE
>
> # diff INFILE OUTFILE
> #
> # ll INFILE OUTFILE
> -rw-r--r--  1 root  wheel  61480 Nov  7 13:09 INFILE
> -rw-r--r--  1 root  wheel  61480 Nov  7 13:38 OUTFILE
>
>
> I had actually tried these combinations, or at least I believe that I
> tried these, before I wrote.  Given the complexity and arcane nature
> of whatever flavour of RE one is working with I may have transgressed
> and written them slightly differently.  But the examples you provided
> me with give the results I obtained exactly.
>
Did you try  tr -d  that I posted earlier?

tr -d works just fine. To wit:

$ cat -v /tmp/x
################################################
^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^

$ tr -d '\000' < /tmp/x > /tmp/x2

$ cat -v /tmp/x2

################################################




More information about the freebsd-questions mailing list