From nobody Sun Oct 20 01:24:27 2024 X-Original-To: ports-bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XWLMH5p81z5ZZgH for ; Sun, 20 Oct 2024 01:24:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XWLMH34yTz4jj8 for ; Sun, 20 Oct 2024 01:24:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729387467; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=nKdjIFHlFurTzx4vkVbbrC/RG2y+tw7LjTTLVAAvvq0=; b=gZLPWAmH7febKxg4attap64DKZBmjT6Do9e2lAj4PzRoMpJ4KsNa3qWZee4JcX+rbKDr5a i1pc6hCFFIZo3RYKKP9/++TDnccPApcgIbUTh5O+xUTdP/v0fLWNVy2wqLQXMGdzLqGmd+ vy4+T6H8DOmbCoaMbSGu5OD9UT78DPeRHkKCnrz0f4anjIyBOjcGfgdKyYEVk1IW5ZLCA1 iZj0JfPWp+RHhMEZX2ALbFcDD9RUxoX9I5fN5tjSwhIU67lFABHS5JanqLNPX6YHL+aaDe KLwhu8gL7tvdWR9rlNharTUmQxQiZd2S5m/8fgmuhXOO0eBz3mMMD+Tx50hLaQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729387467; a=rsa-sha256; cv=none; b=OWiQCd3tcYsD7+J0pLQZ1JKiZwdLAOEipBvU+tmeYLsP+oBNwDcodLIPF21niwC+t9sGss YYrUpDDghNlwVR1rxudejmuPfMmdov1JHihKYfU+58CWe6VoswwTck9tBg2CmNzSTKcQe6 SxK37aCdzKvLbksg8sB+vb+UxaEZ9grWEktoYD6vXTUt8tsN0BTtW9oW+qll9Md2Kax/3u qPujeI2vHCtb/Ea96D8w8CsQv5gxtten2n5dclfAkos2qWZuw/Am748M+2YWeIgMua1x7Q TYbr9NqM2voZhdWXgUAeW7ufumi/AJKdRXa4m/d2U8MvSXQupcmU+kSvXNWfiw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XWLMH2hhfzhMJ for ; Sun, 20 Oct 2024 01:24:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49K1ORlV025364 for ; Sun, 20 Oct 2024 01:24:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49K1ORPv025363 for ports-bugs@FreeBSD.org; Sun, 20 Oct 2024 01:24:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: ports-bugs@FreeBSD.org Subject: [Bug 282217] databases/couchdb3: Crashes after a few minutes Date: Sun, 20 Oct 2024 01:24:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: erik@nordstroem.no X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: dch@freebsd.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter flagtypes.name Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Ports bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-ports-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-ports-bugs@freebsd.org Sender: owner-freebsd-ports-bugs@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D282217 Bug ID: 282217 Summary: databases/couchdb3: Crashes after a few minutes Product: Ports & Packages Version: Latest Hardware: Any OS: Any Status: New Severity: Affects Many People Priority: --- Component: Individual Port(s) Assignee: dch@freebsd.org Reporter: erik@nordstroem.no Assignee: dch@freebsd.org Flags: maintainer-feedback?(dch@freebsd.org) I am running CouchDB 3.3.3, installed via latest package available in quart= erly package repo. Package version couchdb3-3.3.3_1 Host OS: FreeBSD 14.1-RELEASE-p5 I created a jail, with a config that looks like this: db-4 { host.hostname =3D "db-4"; vnet; vnet.interface =3D "e12b_db_4"; vnet.interface +=3D "e13b_db_4"; exec.poststop +=3D "ifconfig e12a_db_4 destroy"; exec.poststop +=3D "ifconfig e13a_gh_4 destroy"; exec.poststop +=3D "ifconfig epair12 create"; exec.poststop +=3D "ifconfig epair13 create"; sysvsem =3D "new"; sysvmsg =3D "new"; sysvshm =3D "new"; } The jail has the same version of FreeBSD as the host. I installed CouchDB 3.3.3 with `pkg install couchdb3`. I edited the `/usr/local/etc/couchdb3/local.ini` config file according to package message, and set it to listen to IPv6 global address :: I enabled the couchdb3 service and started it. I sent the HTTP PUT requests as instructed: curl -X PUT 'http://admin:notmyactualpasswordobviously@[::]:5984/_users' curl -X PUT 'http://admin:notmyactualpasswordobviously@[::]:5984/_replicator' curl -X PUT 'http://admin:notmyactualpasswordobviously@[::]:5984/_global_changes' The first PUT command succeeded. The second and third ones returned error responses similar to: {"error":"unknown_error","reason":"badarg","ref":1926143316} After a few minutes, CouchDB stops running, as can be observed by there no longer being any process matches for `ps wwwaux | grep couchdb3`. I turned on logging to file at level info. The first few lines of the CouchDB log file look like the following: [info] 2024-10-20T00:46:44.941085Z couchdb@127.0.0.1 <0.254.0> -------- Preflight check: Checking For Monsters [info] 2024-10-20T00:46:44.941137Z couchdb@127.0.0.1 <0.254.0> -------- Preflight check: Asserting Admin Account [info] 2024-10-20T00:46:44.943129Z couchdb@127.0.0.1 <0.254.0> -------- Apache CouchDB 3.3.3 is starting. [info] 2024-10-20T00:46:44.943167Z couchdb@127.0.0.1 <0.255.0> -------- Starting couch_sup [info] 2024-10-20T00:46:44.974439Z couchdb@127.0.0.1 <0.254.0> -------- Apache CouchDB has started. Time to relax. [notice] 2024-10-20T00:46:44.978854Z couchdb@127.0.0.1 <0.329.0> ------= -- rexi_server : started servers [notice] 2024-10-20T00:46:44.979659Z couchdb@127.0.0.1 <0.333.0> ------= -- rexi_buffer : started servers [error] 2024-10-20T00:46:45.011115Z couchdb@127.0.0.1 emulator -------- Error in process <0.353.0> on node 'couchdb@127.0.0.1' with exit value: =20=20=20 {badarg,[{erlang,list_to_integer,[[48,48,48,13,48,13,1,8],16],[{error_info,= #{module =3D> erl_erts_errors}}]},{mem3_util,'-build_shards_by_node/2-fun-0-',5,[{file,"s= rc/mem3_util.erl"},{line,228}]},{lists,map,2,[{file,"lists.erl"},{line,1315= }]},{lists,flatmap_1,2,[{file,"lists.erl"},{line,1335}]},{mem3_shards,fold_= fun,2,[{file,"src/mem3_shards.erl"},{line,332}]},{couch_bt_engine,drop_redu= ctions,4,[{file,"src/couch_bt_engine.erl"},{line,1161}]},{couch_bt_engine,s= kip_deleted,4,[{file,"src/couch_bt_engine.erl"},{line,1151}]},{couch_btree,= stream_kv_node2,8,[{file,"src/couch_btree.erl"},{line,1167}]}]} [error] 2024-10-20T00:46:45.011204Z couchdb@127.0.0.1 emulator -------- Error in process <0.353.0> on node 'couchdb@127.0.0.1' with exit value: =20=20=20 {badarg,[{erlang,list_to_integer,[[48,48,48,13,48,13,1,8],16],[{error_info,= #{module =3D> erl_erts_errors}}]},{mem3_util,'-build_shards_by_node/2-fun-0-',5,[{file,"s= rc/mem3_util.erl"},{line,228}]},{lists,map,2,[{file,"lists.erl"},{line,1315= }]},{lists,flatmap_1,2,[{file,"lists.erl"},{line,1335}]},{mem3_shards,fold_= fun,2,[{file,"src/mem3_shards.erl"},{line,332}]},{couch_bt_engine,drop_redu= ctions,4,[{file,"src/couch_bt_engine.erl"},{line,1161}]},{couch_bt_engine,s= kip_deleted,4,[{file,"src/couch_bt_engine.erl"},{line,1151}]},{couch_btree,= stream_kv_node2,8,[{file,"src/couch_btree.erl"},{line,1167}]}]} [error] 2024-10-20T00:46:45.011323Z couchdb@127.0.0.1 emulator -------- Error in process <0.363.0> on node 'couchdb@127.0.0.1' with exit value: =20=20=20 {badarg,[{erlang,list_to_integer,[[48,48,48,13,48,13,1,8],16],[{error_info,= #{module =3D> erl_erts_errors}}]},{mem3_util,'-build_shards_by_node/2-fun-0-',5,[{file,"s= rc/mem3_util.erl"},{line,228}]},{lists,map,2,[{file,"lists.erl"},{line,1315= }]},{lists,flatmap_1,2,[{file,"lists.erl"},{line,1335}]},{mem3_shards,fold_= fun,2,[{file,"src/mem3_shards.erl"},{line,332}]},{couch_bt_engine,drop_redu= ctions,4,[{file,"src/couch_bt_engine.erl"},{line,1161}]},{couch_bt_engine,s= kip_deleted,4,[{file,"src/couch_bt_engine.erl"},{line,1151}]},{couch_btree,= stream_kv_node2,8,[{file,"src/couch_btree.erl"},{line,1167}]}]} [error] 2024-10-20T00:46:45.011405Z couchdb@127.0.0.1 emulator -------- Error in process <0.363.0> on node 'couchdb@127.0.0.1' with exit value: =20=20=20 {badarg,[{erlang,list_to_integer,[[48,48,48,13,48,13,1,8],16],[{error_info,= #{module =3D> erl_erts_errors}}]},{mem3_util,'-build_shards_by_node/2-fun-0-',5,[{file,"s= rc/mem3_util.erl"},{line,228}]},{lists,map,2,[{file,"lists.erl"},{line,1315= }]},{lists,flatmap_1,2,[{file,"lists.erl"},{line,1335}]},{mem3_shards,fold_= fun,2,[{file,"src/mem3_shards.erl"},{line,332}]},{couch_bt_engine,drop_redu= ctions,4,[{file,"src/couch_bt_engine.erl"},{line,1161}]},{couch_bt_engine,s= kip_deleted,4,[{file,"src/couch_bt_engine.erl"},{line,1151}]},{couch_btree,= stream_kv_node2,8,[{file,"src/couch_btree.erl"},{line,1167}]}]} The log file is quickly filled with a lot of error messages, and the log fi= le grows very quickly to gigabytes in size in just a few minutes. One of the error messages that keeps showing up says "custodian shard check= er died": [notice] 2024-10-20T01:19:03.987934Z couchdb@127.0.0.1 <0.2139.0> -----= --- custodian shard checker died {badarg,[{erlang,list_to_integer,[[48,48,48,13,48,13,1,8],16],[{error_info,= #{module =3D> erl_erts_errors}}]},{mem3_util,'-build_shards_by_node/2-fun-0-',5,[{file,"s= rc/mem3_util.erl"},{line,228}]},{lists,map,2,[{file,"lists.erl"},{line,1315= }]},{lists,flatmap_1,2,[{file,"lists.erl"},{line,1335}]},{custodian_util,fo= ld_dbs1,2,[{file,"src/custodian_util.erl"},{line,83}]},{couch_bt_engine,dro= p_reductions,4,[{file,"src/couch_bt_engine.erl"},{line,1161}]},{couch_bt_en= gine,skip_deleted,4,[{file,"src/couch_bt_engine.erl"},{line,1151}]},{couch_= btree,stream_kv_node2,8,[{file,"src/couch_btree.erl"},{line,1167}]}]} And aside from that one there are similar looking ones to the ones from the beginning of the log. Would appreciate some help here, as I cannot tell from these log files what= is actually going wrong. --=20 You are receiving this mail because: You are the assignee for the bug.=