From nobody Thu May 05 04:55:23 2022 X-Original-To: freebsd-git@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id EF7471ABC4DF for ; Thu, 5 May 2022 04:55:28 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kv1bh6FWxz4h3d; Thu, 5 May 2022 04:55:28 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651726528; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=/ZCo/QNam56oHzsw4ymdguYMheVM2osgqqmeT4dSnTc=; b=VO/eSXpeV94cQRm7hHmYGkaM+rsSgNidHnjd80PTiPkEZIwmUggjpocSnKQEYaP6Sz4MJA VGNhCn1/775CrZcV7BL4fH9n7OHjMVtd0tAEi45J+4rCGv4w7hkOSCfmlexZ2byRZvmiv0 hugjdH/VbY86t4/WgNc1a1tYPc2lW4ZOIus0VSQylqMABYHYQZH0uZ07lDNTUupCI+oUp1 JMSeLALWqsZmnFQjU2sD9gM+yxrBcCaPHyzg6c9TozLdbuPpYlqzRKcL1l5z07wTpsxXyM iDcRu2Wtg7eMyswb6bh6sRCLtayXLCg9HvVwnE6xer4VrEVKq9xTLuS+BPR4sQ== Received: from auth2-smtp.messagingengine.com (auth2-smtp.messagingengine.com [66.111.4.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id AE68EC296; Thu, 5 May 2022 04:55:28 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailauth.nyi.internal (Postfix) with ESMTP id 3F8CC27C0054; Thu, 5 May 2022 00:55:28 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Thu, 05 May 2022 00:55:28 -0400 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrfedtgdekjecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhephffvvefufffokfgjfhggtgesthdtmh dtredttdenucfhrhhomheprfhhihhlihhpucfrrggvphhsuceophhhihhlihhpsehfrhgv vggsshgurdhorhhgqeenucggtffrrghtthgvrhhnpefggfefieegtedtledtgfevtdfftd egvdehueeiteehteefieefveevtedvvdekgeenucevlhhushhtvghrufhiiigvpedtnecu rfgrrhgrmhepmhgrihhlfhhrohhmpehphhhilhhiphdomhgvshhmthhprghuthhhphgvrh hsohhnrghlihhthidqudduieeivdeivdegkedqvdefhedukedttdekqdhphhhilhhiphep pehfrhgvvggsshgurdhorhhgsehtrhhouhgslhgvrdhish X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu, 5 May 2022 00:55:26 -0400 (EDT) From: Philip Paeps To: Chris Cc: Dave Cottlehuber , freebsd-git@freebsd.org Subject: Re: When are the git servers available to obtain the ports tree? Date: Thu, 05 May 2022 12:55:23 +0800 X-Mailer: MailMate (1.14r5893) Message-ID: <3D669FAD-A5E0-43A1-B6F8-72E1541DD790@freebsd.org> In-Reply-To: <129a7e028a367648c0cb0c14f31d2a68@bsdforge.com> References: <7dc2545d68f3d4ebbedef4d29c6161f5@bsdforge.com> <81AFA1F5-E3EE-4E33-A2D7-58DB775674C3@freebsd.org> <26dc45b81218bd3b670145340035ad66@bsdforge.com> <1149BE63-059F-4093-B651-4DF2C413E012@freebsd.org> <129a7e028a367648c0cb0c14f31d2a68@bsdforge.com> List-Id: Discussion of git use in the FreeBSD project List-Archive: https://lists.freebsd.org/archives/freebsd-git List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-git@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1651726528; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=/ZCo/QNam56oHzsw4ymdguYMheVM2osgqqmeT4dSnTc=; b=Tv3bhhPKsa8Y8wnAtDM5ceGUhL7XAB1YUsmZh/+ybaxpyvd148XPTg4Ix+HOOFK+LZAUt4 y+r1bq6BDCrl26H6o8MZSoqGsvTW082K0PCjlqhVPmomtMMMwVFu3XCYRbddBxxwd434+D LqhULpyoCVU2czQWr72SOYK8QF9c0kCGrIl46GeVglyZ5FiryHEazmtwIXpT56Ja944AWr MXbMS/++OVFGnwwkaai99rfBmiPCgT+ecof4n6INbI8qgHPwhsalBhPRgSlrTWJ8QuFwR/ VYPgzpryYvhcEH5H7OS1xKA+LBQAZPSqYjEEl2AM9J0DGsATodVetbTWZJuZ2A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1651726528; a=rsa-sha256; cv=none; b=aN+h/c+ThrxncB6Pn0st29zSWs4t0NvDYkls8OyF8Z+36l5HM6PCfXzReu+C+n6t4zqMsH lapaYJFg4rQ0UPohY6gqqycF2qbN9O7K71Y5TjoKYoqff3Zc+bvu2RBtf5dpxDYST/daAw 1vIaFZiG2LcgZhIlQawoIJtiOEGmuewWMSwL6poIfBojJc7Czfl2ITWgZqGCAk2OO/cpoZ QlD2uzIPLiEe4C+l114rHWs/GJyE6zpG+SEbJ+YXdKiQWYBRDN7wAk/BYq31hHa3cYyx3g U3L4JltCDwK+q0pATnnDEKy+6DBt9tw/jE7kOoHQ79dCHA9sHXObizf5TRGRQA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N On 2022-05-03 23:01:40 (+0800), Chris wrote: > On 2022-05-03 00:48, Dave Cottlehuber wrote: >> There's extensive debugging for git, and for HTTP, you >> could try `GIT_CURL_VERBOSE=1` and see if that helps >> identify problems. > > clusteradm was (is?) kind enough to try and pin it down. So > we exchanged some info last night (mid day for them). I'll > give your suggestion a try. Thanks. I did some more testing. The problem seems to be that the mirror you are using is struggling with its workload. The machine is of an older generation and we're asking a lot of it. New hardware for that mirror is on our radar. Meanwhile, I'll try to find some time in the coming days to move the git mirror to another machine. This is a tedious chore and prone to being preempted by more fun things to do. Please poke me if it looks like I've forgotten. >> If, for some reason, you really need to do a from-scratch >> clone every time, it might be simpler to have a personal >> mirror of just the /main/ branch on github or similar, and >> avoid pulling the whole lot from the mirrors each time. > > While I *do* fetch the entire history. On average, I only ever > do it at most, once a month. So I don't think it's unreasonable, > or that I'm overloading the FreeBSD git services. ;-) I agree that it's not unreasonable. Thanks for reporting this problem. The Git mirrors are still a comparatively new workload on the mirrors. We clearly don't yet have enough monitoring in place to notice problems before users. Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises