Logstash 6.x plugins installation and updates

[Mark Felder]

On Tue, Mar 6, 2018, at 18:17, news via freebsd-elastic wrote:
> On Tue, 06 Mar 2018 22:30:36 +0200, Mark Felder <feld at freebsd.org> wrote:
> 
> >
> >
> > On Mon, Mar 5, 2018, at 11:03, news via freebsd-elastic wrote:
> >>
> >> the expr error is probably a syntax error because it's trying to use gnu
> >> expr and not the one we have on FreeBSD.
> >>

This seems to work now. I found and fixed the expr error. Not a GNU extension -- just an error in jruby which has been fixed upstream, but logstash doesn't bundle a version with this fixed. The update issue was an upstream bug which I've patched for us as well.

root at elk:/usr/local/logstash # ./bin/logstash-plugin install x-pack
Downloading file: https://artifacts.elastic.co/downloads/logstash-plugins/x-pack/x-pack-6.2.2.zip
Downloading [=============================================================] 100%
Installing file: /tmp/studtmp-5dd043f3e10e926cdabe34b8c1870b8ea4c9f0b19159008f6b8c8ee90083/x-pack-6.2.2.zip
Install successful
root at elk:/usr/local/logstash # ./bin/logstash-plugin update
Updating logstash-codec-cef, logstash-codec-collectd, logstash-codec-dots, logstash-codec-edn, logstash-codec-edn_lines, logstash-codec-es_bulk, logstash-codec-fluent, logstash-codec-graphite, logstash-codec-json, logstash-codec-json_lines, logstash-codec-line, logstash-codec-msgpack, logstash-codec-multiline, logstash-codec-netflow, logstash-codec-plain, logstash-codec-rubydebug, logstash-filter-aggregate, logstash-filter-anonymize, logstash-filter-cidr, logstash-filter-clone, logstash-filter-csv, logstash-filter-date, logstash-filter-de_dot, logstash-filter-dissect, logstash-filter-dns, logstash-filter-drop, logstash-filter-elasticsearch, logstash-filter-fingerprint, logstash-filter-geoip, logstash-filter-grok, logstash-filter-jdbc_static, logstash-filter-jdbc_streaming, logstash-filter-json, logstash-filter-kv, logstash-filter-metrics, logstash-filter-mutate, logstash-filter-ruby, logstash-filter-sleep, logstash-filter-split, logstash-filter-syslog_pri, logstash-filter-throttle, logstash-filter-translate, logstash-filter-truncate, logstash-filter-urldecode, logstash-filter-useragent, logstash-filter-xml, logstash-input-beats, logstash-input-dead_letter_queue, logstash-input-elasticsearch, logstash-input-exec, logstash-input-file, logstash-input-ganglia, logstash-input-gelf, logstash-input-generator, logstash-input-graphite, logstash-input-heartbeat, logstash-input-http, logstash-input-http_poller, logstash-input-imap, logstash-input-jdbc, logstash-input-kafka, logstash-input-pipe, logstash-input-rabbitmq, logstash-input-redis, logstash-input-s3, logstash-input-snmptrap, logstash-input-sqs, logstash-input-stdin, logstash-input-syslog, logstash-input-tcp, logstash-input-twitter, logstash-input-udp, logstash-input-unix, logstash-output-cloudwatch, logstash-output-csv, logstash-output-elasticsearch, logstash-output-email, logstash-output-file, logstash-output-graphite, logstash-output-http, logstash-output-kafka, logstash-output-lumberjack, logstash-output-nagios, logstash-output-null, logstash-output-pagerduty, logstash-output-pipe, logstash-output-rabbitmq, logstash-output-redis, logstash-output-s3, logstash-output-sns, logstash-output-sqs, logstash-output-stdout, logstash-output-tcp, logstash-output-udp, logstash-output-webhdfs, x-pack
Updated logstash-codec-fluent 3.1.5 to 3.2.0
Updated logstash-codec-netflow 3.11.0 to 3.11.2
Updated logstash-filter-dns 3.0.7 to 3.0.8
Updated logstash-filter-grok 4.0.2 to 4.0.3
Updated logstash-filter-kv 4.0.3 to 4.1.0
Updated logstash-filter-mutate 3.2.0 to 3.3.1
Updated logstash-input-beats 5.0.6 to 5.0.11
Updated logstash-input-exec 3.1.5 to 3.2.0
Updated logstash-input-jdbc 4.3.3 to 4.3.5
Updated logstash-input-syslog 3.2.4 to 3.4.0
Updated logstash-input-tcp 5.0.3 to 5.0.4
Updated logstash-output-elasticsearch 9.0.2 to 9.0.3


So at this point I think it's safe to say that Logstash on FreeBSD has fewer bugs than on their "supported" platforms. *smirk*


Next up: backporting these fixes to elastic/kibana/logstash 5.x


-- 
  Mark Felder
  ports-secteam & portmgr member
  feld at FreeBSD.org