[HEADSUP] Upcoming GNU sort removal

[Oleg Moskalenko]

Currently the sort structures in the sort utility use 32-bits counters. With Tb files, this may be the limitation point. I can take a look into fixing that.

Oleg

From: Dennis Glatting [mailto:freebsd at penx.com]
Sent: Thursday, October 04, 2012 8:09 PM
To: Gabor Kovesdan
Cc: current at FreeBSD.org; Oleg Moskalenko
Subject: Re: [HEADSUP] Upcoming GNU sort removal

On Thu, 2012-10-04 at 18:16 +0200, Gabor Kovesdan wrote:



Em 04-10-2012 16:50, Dennis Glatting escreveu:

> On Thu, 2012-10-04 at 12:53 +0200, Gabor Kovesdan wrote:

>> > Hi,

>> >

>> > it has been more than 3 months ago that BSD sort became default in HEAD

>> > and no serious complaints have been raised against it since then so I

>> > plan to permanently remove GNU sort from head in the next days. If you

>> > have any objection, please raise it now.

>> >

> Initially I had problems with multi TB files (--unique, five to ten

> files) but I haven't had to do that in two(?) months. I will be getting

> back to that project in a month or so.

>

> It challanges a system's resources. :)



And did it go much better with base GNU sort? It's quite an extreme

case... :) Multi GB is also rare not speaking about multi TB...



Yes. However my problem now is ZFS stability -- typically locking up, case example today:


last pid: 67998;  load averages:  0.00,  0.00,  0.00    up 1+19:50:51  19:02:10
80 processes:  1 running, 79 sleeping
CPU:  0.0% user,  0.0% nice,  0.0% system,  0.0% interrupt,  100% idle
Mem: 146M Active, 2765M Inact, 35G Wired, 371M Buf, 86G Free
ARC: 32G Total, 4141M MRU, 27G MFU, 55M Anon, 485M Header, 614M Other
Swap: 233G Total, 233G Free

  PID USERNAME    THR PRI NICE   SIZE    RES STATE   C   TIME   WCPU COMMAND
17517 root         17  42    4   217M   128M tx->tx 21  25.3H  0.00% pbzip2
17568 root         17  52    4   201M   116M tx->tx 24  25.2H  0.00% pbzip2
17508 root         17  46    4   201M   116M tx->tx 33  24.6H  0.00% pbzip2
17544 root         17  52    4   205M   120M tx->tx 37  24.6H  0.00% pbzip2
17532 root         17  52    4   209M   123M tx->tx 35  24.5H  0.00% pbzip2

etc.