Ludovic Courtès <ludo@HIDDEN>
to control <at> debbugs.gnu.org.
Full text available.Received: (at 77407) by debbugs.gnu.org; 10 Apr 2025 13:10:58 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 10 09:10:58 2025 Received: from localhost ([127.0.0.1]:44352 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1u2rgH-0003qq-Ox for submit <at> debbugs.gnu.org; Thu, 10 Apr 2025 09:10:58 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:44256) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1u2rgE-0003qZ-Bd for 77407 <at> debbugs.gnu.org; Thu, 10 Apr 2025 09:10:55 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1u2rg4-0005lU-0m; Thu, 10 Apr 2025 09:10:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=OqBg2JwKMl1ZYO7pQ2IUf9c48jpsR3HiuIvkCHBH9+s=; b=oR113g4b+MuYEV4o/9F3 3ZZH5qvcAJcSEORvYvjjsfojjhJc1q1DTCLbqvcoUMkdysv2cf68mSpQLEilXc1wt6v06tCjZufGE PvlnZ2OxkHB766GPcaURQKS/kvvLBcoi0cbh+6sPBPRizYX7UDcTp2JolrriZkwkWFTBH/+Yx8Zf4 lNnU/WH8wO8VT6aekNLNj+wxwtUqdjKtd7GtQFCTkoclOFdJnr/brbw2kRW6B/aSzSdTnwlw6kNYK maWUfWZzZ8ZiZni2Uc+gT6zK0koQilMcohFazGVG8ubk7kl1F+3Qnk+3I/VpKTUEvFOgqiXIxAbXY 5GXYvNOlk0YnmA==; From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Christopher Baines <mail@HIDDEN> Subject: Re: bug#77407: shepherd hangs at "herd restart nginx" In-Reply-To: <87lds8xjo5.fsf@HIDDEN> (Christopher Baines's message of "Thu, 10 Apr 2025 13:52:58 +0100") References: <Z-q8iSu5dCaxDicO@jurong> <handler.77407.B.17434369848741.ack <at> debbugs.gnu.org> <Z-q-T7gEyWJabCYT@jurong> <875xjodqgb.fsf@HIDDEN> <87lds9z317.fsf@HIDDEN> <8734egz8jm.fsf@HIDDEN> <87h62wtcn0.fsf@HIDDEN> <87lds8xjo5.fsf@HIDDEN> User-Agent: mu4e 1.12.9; emacs 29.4 X-URL: https://people.bordeaux.inria.fr/lcourtes/ X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu X-Revolutionary-Date: Primidi 21 Germinal an 233 de la =?utf-8?Q?R=C3=A9vo?= =?utf-8?Q?lution=2C?= jour du Gainier Date: Thu, 10 Apr 2025 15:10:40 +0200 Message-ID: <878qo8tb5b.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 77407 Cc: Andreas Enge <andreas@HIDDEN>, 77407 <at> debbugs.gnu.org X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Christopher Baines <mail@HIDDEN> skribis: >>> I've reconfigured one of the machines I was struggling with this issue >>> on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I >>> can no longer reproduce the issue. >> >> Did you try hard enough? :-) As in: >> >> while herd restart nginx; do : ; done > > I did, and previously it happened almost every time I restarted nginx. Phew, that=E2=80=99s a relief. I=E2=80=99ll tag 1.0.4 hopefully next week. Thanks, Ludo=E2=80=99.
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.
Received: (at 77407) by debbugs.gnu.org; 10 Apr 2025 12:53:07 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 10 08:53:07 2025
Received: from localhost ([127.0.0.1]:44309 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1u2rP1-0002vd-12
for submit <at> debbugs.gnu.org; Thu, 10 Apr 2025 08:53:07 -0400
Received: from mira.cbaines.net ([212.71.252.8]:44174)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <mail@HIDDEN>) id 1u2rOy-0002vQ-E5
for 77407 <at> debbugs.gnu.org; Thu, 10 Apr 2025 08:53:05 -0400
Received: from localhost (unknown [IPv6:2a02:6b67:e390:8b00::1ce5])
by mira.cbaines.net (Postfix) with ESMTPSA id 1518527BC49;
Thu, 10 Apr 2025 13:53:03 +0100 (BST)
Received: from fang (localhost [127.0.0.1])
by localhost (OpenSMTPD) with ESMTP id 08d8a7db;
Thu, 10 Apr 2025 12:53:02 +0000 (UTC)
From: Christopher Baines <mail@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#77407: shepherd hangs at "herd restart nginx"
In-Reply-To: <87h62wtcn0.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
=?utf-8?Q?s?= message of "Thu, 10 Apr 2025 14:38:27 +0200")
References: <Z-q8iSu5dCaxDicO@jurong>
<handler.77407.B.17434369848741.ack <at> debbugs.gnu.org>
<Z-q-T7gEyWJabCYT@jurong> <875xjodqgb.fsf@HIDDEN>
<87lds9z317.fsf@HIDDEN> <8734egz8jm.fsf@HIDDEN>
<87h62wtcn0.fsf@HIDDEN>
User-Agent: mu4e 1.12.9; emacs 29.4
Date: Thu, 10 Apr 2025 13:52:58 +0100
Message-ID: <87lds8xjo5.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
micalg=pgp-sha512; protocol="application/pgp-signature"
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 77407
Cc: Andreas Enge <andreas@HIDDEN>, 77407 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Ludovic Court=C3=A8s <ludo@HIDDEN> writes:
> Christopher Baines <mail@HIDDEN> skribis:
>
>>> I just realized: this may well be fixed by Shepherd commit
>>> a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see
>>> <https://issues.guix.gnu.org/77373>.) Would be great to give it a try
>>> somehow.
>>
>> I've reconfigured one of the machines I was struggling with this issue
>> on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I
>> can no longer reproduce the issue.
>
> Did you try hard enough? :-) As in:
>
> while herd restart nginx; do : ; done
I did, and previously it happened almost every time I restarted nginx.
>> There was a failing shepherd test, but I just disabled tests.
>
> If you still have the build log, I=E2=80=99d be happy to see it.
Unfortunately I don't seem to have it, I can't reproduce the failure so
it seems to be a flaky test.
--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmf3vypfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh
aW5lcy5uZXQACgkQXiijOwuE9XdUrRAAl84eFoHgl8dVhb6tMg0LR+MGjiTINrfp
MxVm2vgA9I3feuBWSvvHfxOf7Zb/MXY0wDiTJNrUohpso0VdHQc9ywxYlaBImvdq
PhZ6nnoo7n7+xsViO43VGzWM11cMGT/SZmlAvo/1R/26G/T5Tb4WE7kj3SyePtQq
XS8GCEUag2UmOa9zEiREeSuMCCW31s/m30HlBmpJNqLOkNqnQtMiE1IPQlRRq58M
p8doSX7nwWGH0vwCPtsCqquqMjiKf33eDzL/S3iHo3iwV/kIqb5MfNiCEdGe+rFC
ryHLSaT7YQrYWr+A919emDnOL7pQTLVLns6JnwTJ+Q1045EhHiiMZlqELqy1yMC8
94T2oKpyvvYHzfsi60eiM3ZDWVUN/7Y+k0IknjkqClsiGAJOoWpUYacteEqUdytq
ROQ2i4Aq0+kmlaiVOWuiMsuTxNU5lrqIloBmppWj/2suArifjkqBeM4JbgVArp2r
oILOSlHB6JGFrcYdS/L8SPIL92INQM0Z5GrbquB9aefAU6EEc/0p6A1cRNV362n4
uUnUdZWwyrksNCfAKWdegwXPXrtg5xMJB0IpkWHe8+40s5MwQqhdGO1xoDsxOGzg
hPQroOCkDH7iN77xHf0FWUKvxa+EyJWdZXAWXIymrQCPEA/UdIjsmFb/TvO8NgTc
EkQxy2INRww=
=IPFJ
-----END PGP SIGNATURE-----
--=-=-=--
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.Received: (at 77407) by debbugs.gnu.org; 10 Apr 2025 12:38:37 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 10 08:38:37 2025 Received: from localhost ([127.0.0.1]:44281 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1u2rAz-0002Cd-By for submit <at> debbugs.gnu.org; Thu, 10 Apr 2025 08:38:37 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34094) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1u2rAx-0002CO-8i for 77407 <at> debbugs.gnu.org; Thu, 10 Apr 2025 08:38:35 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1u2rAr-000234-O7; Thu, 10 Apr 2025 08:38:29 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=1X6eiavQnEdE0vearUgZOpMZDj8NRLsbVFApipl8+eQ=; b=SLBCpgSMXEAmDBGRcsoh hdtRrmpOsp6fs+lb0rn82FtuUniczkIZC76afajPibVV40Ep0RsvAALUqkJUzD63JeCCpJogltq+J WlnnQQLk3G5UAzruz9M0Rf12Vt74bEZOHrIiLPRjV3CKUiqgfssg0L0iVxdoYTAgeBMfxZYGf7P1S /Z1Muk3mSddVobH9eTjMetgLxmUUhiknbXZa0SEy+d15BL2OtBU8IZ/u7TQB7Ec9ozPBMWusJS4IH KGibiQXhlBfwOjbzosj8KRj2DOy3/64Zw0ehmCA3b0vU0U8cFyxyY+AhEOGOjTZMDazUUkh4Rc3I/ cuum6/hR8ZHEwA==; From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Christopher Baines <mail@HIDDEN> Subject: Re: bug#77407: shepherd hangs at "herd restart nginx" In-Reply-To: <8734egz8jm.fsf@HIDDEN> (Christopher Baines's message of "Thu, 10 Apr 2025 10:10:21 +0100") References: <Z-q8iSu5dCaxDicO@jurong> <handler.77407.B.17434369848741.ack <at> debbugs.gnu.org> <Z-q-T7gEyWJabCYT@jurong> <875xjodqgb.fsf@HIDDEN> <87lds9z317.fsf@HIDDEN> <8734egz8jm.fsf@HIDDEN> User-Agent: mu4e 1.12.9; emacs 29.4 X-URL: https://people.bordeaux.inria.fr/lcourtes/ X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu X-Revolutionary-Date: Primidi 21 Germinal an 233 de la =?utf-8?Q?R=C3=A9vo?= =?utf-8?Q?lution=2C?= jour du Gainier Date: Thu, 10 Apr 2025 14:38:27 +0200 Message-ID: <87h62wtcn0.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 77407 Cc: Andreas Enge <andreas@HIDDEN>, 77407 <at> debbugs.gnu.org X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Christopher Baines <mail@HIDDEN> skribis: >> I just realized: this may well be fixed by Shepherd commit >> a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see >> <https://issues.guix.gnu.org/77373>.) Would be great to give it a try >> somehow. > > I've reconfigured one of the machines I was struggling with this issue > on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I > can no longer reproduce the issue. Did you try hard enough? :-) As in: while herd restart nginx; do : ; done > There was a failing shepherd test, but I just disabled tests. If you still have the build log, I=E2=80=99d be happy to see it. Thanks for testing! Ludo=E2=80=99.
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.
Received: (at 77407) by debbugs.gnu.org; 10 Apr 2025 09:10:31 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 10 05:10:31 2025
Received: from localhost ([127.0.0.1]:43834 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1u2nvb-0003ks-85
for submit <at> debbugs.gnu.org; Thu, 10 Apr 2025 05:10:31 -0400
Received: from mira.cbaines.net
([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]:38927)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <mail@HIDDEN>) id 1u2nvY-0003kR-Jg
for 77407 <at> debbugs.gnu.org; Thu, 10 Apr 2025 05:10:29 -0400
Received: from localhost (unknown [IPv6:2a02:6b67:e390:8b00::1ce5])
by mira.cbaines.net (Postfix) with ESMTPSA id 0CBC827BC49;
Thu, 10 Apr 2025 10:10:27 +0100 (BST)
Received: from fang (localhost [127.0.0.1])
by localhost (OpenSMTPD) with ESMTP id 42543a94;
Thu, 10 Apr 2025 09:10:26 +0000 (UTC)
From: Christopher Baines <mail@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#77407: shepherd hangs at "herd restart nginx"
In-Reply-To: <87lds9z317.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
=?utf-8?Q?s?= message of "Wed, 09 Apr 2025 18:57:08 +0200")
References: <Z-q8iSu5dCaxDicO@jurong>
<handler.77407.B.17434369848741.ack <at> debbugs.gnu.org>
<Z-q-T7gEyWJabCYT@jurong> <875xjodqgb.fsf@HIDDEN>
<87lds9z317.fsf@HIDDEN>
User-Agent: mu4e 1.12.9; emacs 29.4
Date: Thu, 10 Apr 2025 10:10:21 +0100
Message-ID: <8734egz8jm.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
micalg=pgp-sha512; protocol="application/pgp-signature"
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 77407
Cc: Andreas Enge <andreas@HIDDEN>, 77407 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Ludovic Court=C3=A8s <ludo@HIDDEN> writes:
> I just realized: this may well be fixed by Shepherd commit
> a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see
> <https://issues.guix.gnu.org/77373>.) Would be great to give it a try
> somehow.
I've reconfigured one of the machines I was struggling with this issue
on with shepherd commit 8d31cafbdcb818160852a5d1e6fc24c1a9c53e41 and I
can no longer reproduce the issue.
There was a failing shepherd test, but I just disabled tests.
--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmf3iv1fFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh
aW5lcy5uZXQACgkQXiijOwuE9XdIjA/+N5FsyOkJNsjQWKZP6b9L0NwG0C8nDnKV
SdNsh0uP7Ri10gXoy1kPpp/taW7eLBEMMdd+Rv4JKyHTD/kcLPobHVZ1iq67TGqb
aHh+terA+Pr6+fYqEKlbJO76f4y3pS5qCPEoMLc6otrtx3v28BNwzsQ1LIamxKjN
Wnrxu6/GWB4x26SsbmvWA1IqOyVil7Jo3g6M14NpwKfmkuCkABmgXvAMiO3NoaVv
2XpR1UoBg+Aa5Sua/nkKLEET7okoZI8Asyrjg9yCReuHF+nfk1GYe5uv8LCIQvti
1t8rXGgdoOX3q5zUU2UvzL+lrHKG/7ype440ElUQg0C6MD2thN/kx0BV8Btonczo
8XGhJZXWuPYVCe5UsMq2WdOce47vYw/dVSFCoIi4Y2fjXZNbp24PVKlwCNr0r6Vy
MY7fMpG7PUsDcK78xlw+CcDRw0i3DKAhQzOhyLTxNp5s/H0l7VGVL/CjCTwpURUX
pKZK28FvLVT9Hfv45c/tgDJW6fIo8fcO2A2SfYUP9hPRWHM2wSmfAV8LTRxxyWCQ
p92NPuF38ZPYGoN4tqhyn3aDTBHvzqXGj17piNcPKfch2owXQkhz33qSxIdDf/v/
D0wDbCGGSIdgSZHhQqk2XZpAEAQ0SkJxdZCUhJNl5B4WOwZMwkXdRM/htR6ZoKSc
rn+54U950AA=
=7+xX
-----END PGP SIGNATURE-----
--=-=-=--
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.
Received: (at 77407) by debbugs.gnu.org; 9 Apr 2025 16:57:31 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Apr 09 12:57:30 2025
Received: from localhost ([127.0.0.1]:41435 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1u2Yjx-0000J1-QA
for submit <at> debbugs.gnu.org; Wed, 09 Apr 2025 12:57:30 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:57464)
by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1u2Yju-0000Ik-Ne
for 77407 <at> debbugs.gnu.org; Wed, 09 Apr 2025 12:57:28 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
id 1u2Yjn-0002B8-UM; Wed, 09 Apr 2025 12:57:19 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
From; bh=EoyKtY2BjFibLaRwTBlBUfONku6rpZ5O96hpK8W85qg=; b=g3mWc5W3fF0ofl+RSVns
wnGiwojuXm3Oms2zSW7t9s+OZBTWSoPyEcR0veYoQrK/aQ8iv0v+dUDVt5BYNlkzGcJSzO9EbMGNU
p4jguI4atlVEJaMNHuYg1481SqZa3jU8vJ22MxiXK+2z58/+W6nc0jPio8YxL9X0ROjplVnujepik
lspbrV2/S+3hUgsgs2psAxZKuK6jwNNiO/CjTvMoI8PAQ3g4WmMWBk+aIQmoyQUBv3Pw8x2X66CPp
hiAzItXX9NlIPqVQmDVpUc8kucEortXzB+S4WnJ4bCl3YNUtAe3M28d28sk4w99X63+PH7ZXyO1zQ
ocTat4lJX8GGsA==;
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Andreas Enge <andreas@HIDDEN>
Subject: Re: bug#77407: shepherd hangs at "herd restart nginx"
In-Reply-To: <875xjodqgb.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
=?utf-8?Q?s?= message of "Tue, 01 Apr 2025 14:19:32 +0200")
References: <Z-q8iSu5dCaxDicO@jurong>
<handler.77407.B.17434369848741.ack <at> debbugs.gnu.org>
<Z-q-T7gEyWJabCYT@jurong> <875xjodqgb.fsf@HIDDEN>
Date: Wed, 09 Apr 2025 18:57:08 +0200
Message-ID: <87lds9z317.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 77407
Cc: 77407 <at> debbugs.gnu.org, mail@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)
Hi!
I just realized: this may well be fixed by Shepherd commit
a5d9a41aa0bfadea9617df4411b86c6ea0c525bd (see
<https://issues.guix.gnu.org/77373>.) Would be great to give it a try
somehow.
Anyway, some more data.
Yesterday I ran =E2=80=98herd stop nginx=E2=80=99 on bayfront (which was ru=
nning 1.0.2),
again causing =E2=80=98herd status=E2=80=99 to hang afterwards. This time =
I captured an
strace log of PID=C2=A01.
The /var/log/messages showing what happens after =E2=80=98herd stop nginx=
=E2=80=99
--8<---------------cut here---------------start------------->8---
2025-04-08 11:28:27 localhost shepherd[1]: Stopping service certbot-certifi=
cate-renewal...
2025-04-08 11:28:27 localhost shepherd[1]: Terminating timer 'certbot-certi=
ficate-renewal' with 0 processes running.
2025-04-08 11:28:27 localhost shepherd[1]: Service certbot-certificate-rene=
wal stopped.
2025-04-08 11:28:27 localhost shepherd[1]: Service certbot-certificate-rene=
wal is now stopped.
2025-04-08 11:28:27 localhost shepherd[1]: Stopping service nginx...
2025-04-08 11:28:27 localhost shepherd[1]: Registering new logger for nginx.
2025-04-08 11:28:28 localhost shepherd[1]: [nginx] nginx: [alert] could not=
open error log file: open() "/gnu/store/w2pi23rrk1dy95rzpb9l87gcj3c4jb38-n=
ginx-1.27.3/logs/error.log" failed (2: No such file or directory)
2025-04-08 11:28:29 localhost shepherd[1]: [nginx] 2025/04/08 11:28:28 [war=
n] 12958#0: duplicate MIME type "text/html" in /gnu/store/plpbgkr7wxl0qm4v0=
zf24vkvznvlc28y-nginx.conf:1043
2025-04-08 11:28:29 localhost shepherd[1]: [nginx] 2025/04/08 11:28:28 [war=
n] 12958#0: duplicate MIME type "text/html" in /gnu/store/plpbgkr7wxl0qm4v0=
zf24vkvznvlc28y-nginx.conf:1107
2025-04-08 11:28:29 localhost shepherd[1]: [nginx] 2025/04/08 11:28:28 [war=
n] 12958#0: duplicate MIME type "text/html" in /gnu/store/plpbgkr7wxl0qm4v0=
zf24vkvznvlc28y-nginx.conf:4100
2025-04-08 11:28:32 localhost shepherd[1]: [nginx] 2025/04/08 11:28:28 [war=
n] 12958#0: conflicting server name "bayfront.guix.gnu.org" on 0.0.0.0:80, =
ignored
2025-04-08 11:28:32 localhost shepherd[1]: Service nginx might have failed =
to stop.
2025-04-08 11:28:32 localhost shepherd[1]: [nginx] 2025/04/08 11:28:28 [war=
n] 12958#0: conflicting server name "logs.guix.gnu.org" on 0.0.0.0:80, igno=
red
2025-04-08 11:28:32 localhost shepherd[1]: Service nginx is now stopped.
2025-04-08 11:28:32 localhost shepherd[1]: Accepted connection on 0.0.0.0:2=
2 from 101.35.215.239:37996.
2025-04-08 11:29:40 localhost shepherd[1]: 2 connections still in use after=
sshd-25913 termination.
2025-04-08 11:29:40 localhost shepherd[1]: Service sshd-25913 (PID 12257) e=
xited with 3.
2025-04-08 11:29:40 localhost shepherd[1]: Service sshd-25913 has been disa=
bled.
2025-04-08 11:32:37 localhost shepherd[1]: Accepted connection on [::]:22 f=
rom [2a0c:e300::58]:40428.
--8<---------------cut here---------------end--------------->8---
(The =E2=80=9Cmight have failed to stop=E2=80=9D bit is harmless and fixed =
in
3f4438741615aa1a1198f9415be8bd110138d83e.)
On berlin, which does not exhibit the bug, we get something similar (for
=E2=80=98herd restart nginx=E2=80=99 here):
--8<---------------cut here---------------start------------->8---
2025-04-07 16:11:25 localhost shepherd[1]: Stopping service certbot-renewal=
...
2025-04-07 16:11:25 localhost shepherd[1]: Terminating timer 'certbot-renew=
al' with 0 processes running.
2025-04-07 16:11:25 localhost shepherd[1]: Service certbot-renewal stopped.
2025-04-07 16:11:25 localhost shepherd[1]: Service certbot-renewal is now s=
topped.
2025-04-07 16:11:26 localhost shepherd[1]: Stopping service nginx...
2025-04-07 16:11:26 localhost shepherd[1]: Registering new logger for nginx.
2025-04-07 16:11:26 localhost shepherd[1]: [nginx] nginx: [alert] could not=
open error log file: open() "/gnu/store/40mb76jc9qbm0d36qyncnpgrgsfab0db-n=
ginx-1.27.3/logs/error.log" failed (2: No such file or directory)
2025-04-07 16:11:26 localhost shepherd[1]: [nginx] 2025/04/07 16:11:26 [war=
n] 27359#0: duplicate MIME type "text/html" in /gnu/store/s2yrd68wr9cd2iirc=
900491qgigyfg0z-nginx.conf:3593
2025-04-07 16:11:26 localhost shepherd[1]: [nginx] 2025/04/07 16:11:26 [not=
ice] 27359#0: signal process started
2025-04-07 16:11:26 localhost shepherd[1]: Service nginx stopped.
2025-04-07 16:11:26 localhost shepherd[1]: Service nginx is now stopped.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/bootstrappable.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/issues-guix-gnu-org.https.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/qualif.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/disarchive.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/bootstrappable.https.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/dump-guix-gnu-org.https.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/workflows-guix-info.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/workflows-guix-info.https.access.log.
2025-04-07 16:11:26 localhost shepherd[1]: Starting service user-homes...
2025-04-07 16:11:26 localhost shepherd[1]: Service user-homes has been star=
ted.
2025-04-07 16:11:26 localhost shepherd[1]: Service user-homes started.
2025-04-07 16:11:26 localhost shepherd[1]: Service user-homes running with =
value #t.
2025-04-07 16:11:26 localhost shepherd[1]: Respawning anonip-/var/log/anoni=
p/https.access.log.
--8<---------------cut here---------------end--------------->8---
Unfortunately the strace log isn=E2=80=99t very helpful:
--8<---------------cut here---------------start------------->8---
11:28:27 read(54, "(shepherd-command (version 0) (action stop) (service ngi=
nx) (arguments ()) (directory \"/home/ludo/src/maintenance/hydra\"))", 1024=
) =3D 122 <0.000162>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3267=
73810}) =3D 0 <0.000043>
11:28:27 epoll_wait(11, [], 16, 0) =3D 0 <0.000040>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3270=
37318}) =3D 0 <0.000040>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3272=
07449}) =3D 0 <0.000040>
11:28:27 epoll_wait(11, [], 16, 0) =3D 0 <0.000037>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3274=
33802}) =3D 0 <0.000038>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3276=
98776}) =3D 0 <0.000038>
11:28:27 epoll_wait(11, [], 16, 0) =3D 0 <0.000036>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3279=
23662}) =3D 0 <0.000038>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3281=
14326}) =3D 0 <0.000038>
11:28:27 epoll_wait(11, [], 16, 0) =3D 0 <0.000038>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3283=
38724}) =3D 0 <0.000038>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3558=
46206}) =3D 0 <0.000069>
11:28:27 epoll_wait(11, [{events=3DEPOLLIN, data=3D{u32=3D38, u64=3D38}}], =
16, 0) =3D 1 <0.000045>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D3561=
63002}) =3D 0 <0.000041>
11:28:27 read(38, "G", 1) =3D 1 <0.000049>
11:28:27 read(38, "E", 1) =3D 1 <0.000038>
11:28:27 read(38, "T", 1) =3D 1 <0.000038>
[=E2=80=A6]
11:28:27 write(7, "Stopping service certbot-certificate-renewal...\n", 48) =
=3D 48 <0.000052>
[=E2=80=A6]
11:28:27 write(25, "2025-04-08 11:28:27 localhost shepherd[1]: Service cert=
bot-certificate-renewal stopped.\n", 88) =3D 88 <0.000049>
[=E2=80=A6]
11:28:27 write(24, "shepherd[1]: Stopping service nginx...\n", 39) =3D 39 <=
0.000050>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D5604=
64210}) =3D 0 <0.000045>
11:28:27 epoll_wait(11, [{events=3DEPOLLIN, data=3D{u32=3D17, u64=3D17}}], =
16, 0) =3D 1 <0.000040>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D5607=
15007}) =3D 0 <0.000042>
11:28:27 getuid() =3D 0 <0.000052>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D6879=
26724}) =3D 0 <0.000040>
11:28:27 epoll_wait(11, [], 16, 0) =3D 0 <0.000038>
11:28:27 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104507, tv_nsec=3D6881=
78499}) =3D 0 <0.000037>
11:28:27 rt_sigprocmask(SIG_BLOCK, [HUP INT TERM CHLD], [HUP INT TERM CHLD]=
, 8) =3D 0 <0.000055>
11:28:27 pipe2([56, 59], O_CLOEXEC) =3D 0 <0.000060>
11:28:27 fcntl(56, F_GETFL) =3D 0 (flags O_RDONLY) <0.000038>
11:28:27 lseek(56, 0, SEEK_CUR) =3D -1 ESPIPE (Illegal seek) <0.000=
037>
11:28:27 fcntl(59, F_GETFL) =3D 0x1 (flags O_WRONLY) <0.000036>
11:28:27 lseek(59, 0, SEEK_CUR) =3D -1 ESPIPE (Illegal seek) <0.000=
036>
11:28:27 rt_sigprocmask(SIG_BLOCK, NULL, [HUP INT TERM CHLD], 8) =3D 0 <0.0=
00035>
11:28:27 clone(child_stack=3DNULL, flags=3DCLONE_CHILD_CLEARTID|CLONE_CHILD=
_SETTID|SIGCHLD, child_tidptr=3D0x7f01e6e99850) =3D 12958 <0.008960>
11:28:27 fcntl(56, F_GETFL) =3D 0 (flags O_RDONLY) <0.000040>
11:28:27 fcntl(56, F_SETFL, O_RDONLY|O_NONBLOCK) =3D 0 <0.000039>
11:28:27 close(59) =3D 0 <0.000039>
11:28:27 rt_sigprocmask(SIG_SETMASK, [HUP INT TERM CHLD], [HUP INT TERM CHL=
D], 8) =3D 0 <0.000038>
11:28:27 recvfrom(17, "shepherd[1]: Stopping service nginx...\n", 1024, 0, =
0x7ffc10c01010, [112 =3D> 0]) =3D 39 <0.000060>
[=E2=80=A6]
11:28:27 read(56, 0x7f01d9a634d0, 1) =3D -1 EAGAIN (Resource temporarily=
unavailable) <0.000040>
11:28:27 epoll_ctl(11, EPOLL_CTL_MOD, 56, {events=3DEPOLLIN|EPOLLRDHUP|EPOL=
LONESHOT, data=3D{u32=3D56, u64=3D56}}) =3D -1 ENOENT (No such file or dire=
ctory) <0.000041>
11:28:27 epoll_ctl(11, EPOLL_CTL_ADD, 56, {events=3DEPOLLIN|EPOLLRDHUP|EPOL=
LONESHOT, data=3D{u32=3D56, u64=3D56}}) =3D 0 <0.000043>
11:28:27 write(7, "Registering new logger for nginx.\n", 34) =3D 34 <0.0000=
48>
[=E2=80=A6]
11:28:28 read(56, "n", 1) =3D 1 <0.000049>
11:28:28 read(56, "g", 1) =3D 1 <0.000046>
11:28:28 read(56, "i", 1) =3D 1 <0.000042>
11:28:28 read(56, "n", 1) =3D 1 <0.000040>
11:28:28 read(56, "x", 1) =3D 1 <0.000039>
11:28:28 read(56, ":", 1) =3D 1 <0.000039>
11:28:28 read(56, " ", 1) =3D 1 <0.000062>
11:28:28 read(56, "[", 1) =3D 1 <0.000039>
11:28:28 read(56, "a", 1) =3D 1 <0.000042>
11:28:28 read(56, "l", 1) =3D 1 <0.000042>
11:28:28 read(56, "e", 1) =3D 1 <0.000041>
11:28:28 read(56, "r", 1) =3D 1 <0.000044>
11:28:28 read(56, "t", 1) =3D 1 <0.000064>
11:28:28 read(56, "]", 1) =3D 1 <0.000043>
[=E2=80=A6]
11:28:29 write(7, "[", 1) =3D 1 <0.000048>
11:28:29 write(7, "nginx", 5) =3D 5 <0.000035>
11:28:29 write(7, "] ", 2) =3D 2 <0.000034>
11:28:29 write(7, "2025/04/08 11:28:28 [warn] 12958#0: duplicate MIME type =
\"text/html\" in /gnu/store/plpbgkr7wxl0qm4v0zf24vkvznvlc28y-nginx.conf:104=
3", 130) =3D 130 <0.000036>
11:28:29 write(7, "\n", 1) =3D 1 <0.000036>
[=E2=80=A6]
11:28:32 accept4(57, {sa_family=3DAF_INET, sin_port=3Dhtons(37996), sin_add=
r=3Dinet_addr("101.35.215.239")}, [112 =3D> 16], SOCK_CLOEXEC) =3D 54 <0.00=
0058>
11:28:32 write(7, "Accepted connection on 0.0.0.0:22 from 101.35.215.239:37=
996.\n", 61) =3D 61 <0.000050>
11:28:32 fcntl(54, F_GETFL) =3D 0x2 (flags O_RDWR) <0.000037>
11:28:32 fcntl(54, F_SETFL, O_RDWR) =3D 0 <0.000037>
11:28:32 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104512, tv_nsec=3D5125=
07676}) =3D 0 <0.000037>
11:28:32 rt_sigprocmask(SIG_BLOCK, NULL, [HUP INT TERM CHLD], 8) =3D 0 <0.0=
00035>
11:28:32 epoll_wait(11, [{events=3DEPOLLIN, data=3D{u32=3D6, u64=3D6}}], 16=
, 273) =3D 1 <0.000039>
11:28:32 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104512, tv_nsec=3D5129=
33004}) =3D 0 <0.000037>
[=E2=80=A6]
11:28:52 accept4(16, 0x7ffc10c01010, [112], SOCK_CLOEXEC|SOCK_NONBLOCK) =3D=
-1 EAGAIN (Resource temporarily unavailable) <0.000057>
11:28:52 epoll_ctl(11, EPOLL_CTL_MOD, 16, {events=3DEPOLLIN|EPOLLRDHUP|EPOL=
LONESHOT, data=3D{u32=3D16, u64=3D16}}) =3D 0 <0.000042>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4481=
97354}) =3D 0 <0.000037>
11:28:52 epoll_wait(11, [], 16, 0) =3D 0 <0.000038>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4484=
34462}) =3D 0 <0.000036>
11:28:52 newfstatat(AT_FDCWD, "/etc/localtime", {st_mode=3DS_IFREG|0444, st=
_size=3D2962, ...}, 0) =3D 0 <0.000046>
11:28:52 write(41, "2025-04-08 11:28:52 39:4 17 (call-with-sigint _ _)=
\n", 56) =3D 56 <0.000105>
11:28:52 newfstatat(AT_FDCWD, "/etc/localtime", {st_mode=3DS_IFREG|0444, st=
_size=3D2962, ...}, 0) =3D 0 <0.000045>
11:28:52 write(41, "2025-04-08 11:28:52 In fibers.scm:\n", 35) =3D 35 <0.00=
0058>
11:28:52 newfstatat(AT_FDCWD, "/etc/localtime", {st_mode=3DS_IFREG|0444, st=
_size=3D2962, ...}, 0) =3D 0 <0.000045>
11:28:52 write(19, "2025-04-08 11:28:52 localhost sudo: ludo : TTY=3Dpt=
s/9 ; PWD=3D/home/ludo/src/maintenance/hydra ; USER=3Droot ; COMMAND=3D/run=
/current-system/profile/bin/herd status nginx\n", 168) =3D 168 <0.000062>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4502=
11551}) =3D 0 <0.000039>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4503=
87060}) =3D 0 <0.000039>
11:28:52 newfstatat(AT_FDCWD, "/etc/localtime", {st_mode=3DS_IFREG|0444, st=
_size=3D2962, ...}, 0) =3D 0 <0.000045>
11:28:52 write(19, "2025-04-08 11:28:52 localhost sudo: pam_unix(sudo:sessi=
on): session opened for user root(uid=3D0) by (uid=3D30012)\n", 111) =3D 11=
1 <0.000051>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4509=
34120}) =3D 0 <0.000038>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4510=
64163}) =3D 0 <0.000059>
11:28:52 read(59, "(shepherd-command (version 0) (action status) (service n=
ginx) (arguments ()) (directory \"/home/ludo/src/maintenance/hydra\"))", 10=
24) =3D 124 <0.000084>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4522=
17926}) =3D 0 <0.000040>
11:28:52 epoll_wait(11, [], 16, 0) =3D 0 <0.000044>
11:28:52 clock_gettime(CLOCK_REALTIME, {tv_sec=3D1744104532, tv_nsec=3D4524=
60901}) =3D 0 <0.000039>
--8<---------------cut here---------------end--------------->8---
At that point it was still accepting connections on
/var/run/shepherd/socket and reading them, reading process output and
logging it, but not much else.
For example, the =E2=80=9CAccepted connection on =E2=80=A6:22=E2=80=9D mess=
ages do not have a
corresponding =E2=80=98clone=E2=80=99 call and not even =E2=80=9CStarting s=
ervice sshd-1234...=E2=80=9D
as we=E2=80=99d normally see right after.
Ludo=E2=80=99.
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.Received: (at 77407) by debbugs.gnu.org; 1 Apr 2025 12:20:07 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Tue Apr 01 08:20:07 2025 Received: from localhost ([127.0.0.1]:46885 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tzab7-0001Jw-Uj for submit <at> debbugs.gnu.org; Tue, 01 Apr 2025 08:20:06 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:45460) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1tzab5-0001IU-BF for 77407 <at> debbugs.gnu.org; Tue, 01 Apr 2025 08:20:04 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1tzaaz-0000fl-8U; Tue, 01 Apr 2025 08:19:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=yofIY++KGG5plzKNV8eLkOx8p4E5AbvgtTP3FGJeGAY=; b=ZXGMTEBZre+PdHkXkOeq JIh017XnC+ZZ8IDNqy0nGqCmrfw1q4VCm56XRo9V29dL8YJo2IecbRtyi35iOXS/dS/sZq6xVA80n my+4lhzJNeiCaLeIZy+lf/fVb2bW6R3ma42+QwHycGjgom6NRvk40d6FdJESUSwgJXYOi3SVbvvrm Mwtp9HS3Iab1HtOQMlmf99DQpkCC7m5Nha545qDFup/nW1b4gmieUN7IOz6PW/OtQOqhTLfi3jsqb vITJ+wZ7JdpWcB1i1/w/G5nieBFf6FxdJJSn/B3I4nhVwJoTxuFgCRSgxUvq6DLhfEHSoqdGV6MnB e66OpxzU0okpWw==; From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Andreas Enge <andreas@HIDDEN> Subject: Re: shepherd hangs at "herd restart nginx" In-Reply-To: <Z-q-T7gEyWJabCYT@jurong> (Andreas Enge's message of "Mon, 31 Mar 2025 18:09:51 +0200") References: <Z-q8iSu5dCaxDicO@jurong> <handler.77407.B.17434369848741.ack <at> debbugs.gnu.org> <Z-q-T7gEyWJabCYT@jurong> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: Duodi 12 Germinal an 233 de la =?utf-8?Q?R=C3=A9volu?= =?utf-8?Q?tion=2C?= jour du Charme X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 01 Apr 2025 14:19:32 +0200 Message-ID: <875xjodqgb.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 77407 Cc: 77407 <at> debbugs.gnu.org, mail@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hello, Andreas Enge <andreas@HIDDEN> skribis: > Today I noticed that the QA webpage was 502 on bayfront. > I restarted qa-frontpage and bffe without problem. > When trying to do "herd restart nginx", the command did not show any > output and did not come back. Moreover, "herd status" also hang without > any output. FWIW, I tested =E2=80=98bare-bones.tmpl=E2=80=99 with just nginx added; run= ning: while herd restart nginx; do : ; done in that VM didn=E2=80=99t trigger the hang. So I=E2=80=99m a bit at loss as to why this fails on bayfront. If someone = has ideas (and time!) on how to get a config closer to that of bayfront that we could test in a VM, that=E2=80=99d be great. Otherwise, we=E2=80=99ll h= ave to debug in production=E2=80=A6 > I could still ssh into the machine and then, thanks to Ludovic, reboot > with the magic command > guix shell guile shepherd -- guile -c '(use-modules (shepherd system)) = (sync) (reboot-kexec)' To be clear: this should be a last resort. :-) Thanks, Ludo=E2=80=99.
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.Ludovic Courtès <ludo@HIDDEN>
to control <at> debbugs.gnu.org.
Full text available.Received: (at 77407) by debbugs.gnu.org; 31 Mar 2025 16:10:04 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Mar 31 12:10:04 2025 Received: from localhost ([127.0.0.1]:42551 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tzHi7-0003Mw-IV for submit <at> debbugs.gnu.org; Mon, 31 Mar 2025 12:10:04 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:47236) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <andreas@HIDDEN>) id 1tzHi5-0003LX-1F for 77407 <at> debbugs.gnu.org; Mon, 31 Mar 2025 12:10:01 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 3EF6842D; Mon, 31 Mar 2025 18:09:54 +0200 (CEST) Authentication-Results: hera.aquilenet.fr; none X-Virus-Scanned: Debian amavis at hera.aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP id cqNBlViN1bkP; Mon, 31 Mar 2025 18:09:53 +0200 (CEST) Received: from jurong (176-179-191-150.abo.bbox.fr [176.179.191.150]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 542603B2; Mon, 31 Mar 2025 18:09:53 +0200 (CEST) Date: Mon, 31 Mar 2025 18:09:51 +0200 From: Andreas Enge <andreas@HIDDEN> To: 77407 <at> debbugs.gnu.org Subject: Re: shepherd hangs at "herd restart nginx" Message-ID: <Z-q-T7gEyWJabCYT@jurong> References: <Z-q8iSu5dCaxDicO@jurong> <handler.77407.B.17434369848741.ack <at> debbugs.gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <handler.77407.B.17434369848741.ack <at> debbugs.gnu.org> X-Rspamd-Queue-Id: 3EF6842D X-Spamd-Result: default: False [-7.89 / 15.00]; REPLY(-4.00)[]; BAYES_HAM(-3.00)[99.99%]; NEURAL_HAM(-1.29)[-0.431]; MID_RHS_NOT_FQDN(0.50)[]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Action: no action X-Spamd-Bar: ------- X-Rspamd-Server: hera X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: 77407 Cc: ludo@HIDDEN, mail@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Today I noticed that the QA webpage was 502 on bayfront. I restarted qa-frontpage and bffe without problem. When trying to do "herd restart nginx", the command did not show any output and did not come back. Moreover, "herd status" also hang without any output. I could still ssh into the machine and then, thanks to Ludovic, reboot with the magic command guix shell guile shepherd -- guile -c '(use-modules (shepherd system)) (sync) (reboot-kexec)' Andreas
bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.Received: (at submit) by debbugs.gnu.org; 31 Mar 2025 16:03:04 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Mar 31 12:03:04 2025 Received: from localhost ([127.0.0.1]:42536 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tzHbL-0002Gp-RP for submit <at> debbugs.gnu.org; Mon, 31 Mar 2025 12:03:04 -0400 Received: from lists.gnu.org ([2001:470:142::17]:35934) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <andreas@HIDDEN>) id 1tzHbH-00029s-80 for submit <at> debbugs.gnu.org; Mon, 31 Mar 2025 12:03:01 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <andreas@HIDDEN>) id 1tzHak-0006ch-A6 for bug-guix@HIDDEN; Mon, 31 Mar 2025 12:02:26 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <andreas@HIDDEN>) id 1tzHai-0006S7-Bl for bug-guix@HIDDEN; Mon, 31 Mar 2025 12:02:26 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 9946542D; Mon, 31 Mar 2025 18:02:20 +0200 (CEST) Authentication-Results: hera.aquilenet.fr; none X-Virus-Scanned: Debian amavis at hera.aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP id ioIkK8xrnvgl; Mon, 31 Mar 2025 18:02:20 +0200 (CEST) Received: from jurong (176-179-191-150.abo.bbox.fr [176.179.191.150]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 8B65C3B2; Mon, 31 Mar 2025 18:02:19 +0200 (CEST) Date: Mon, 31 Mar 2025 18:02:17 +0200 From: Andreas Enge <andreas@HIDDEN> To: bug-guix@HIDDEN Subject: shepherd hangs at "herd restart nginx" Message-ID: <Z-q8iSu5dCaxDicO@jurong> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 9946542D X-Spamd-Result: default: False [7.22 / 15.00]; SPAM_FLAG(5.00)[]; NEURAL_SPAM(3.00)[0.999]; BAYES_HAM(-1.18)[88.96%]; MID_RHS_NOT_FQDN(0.50)[]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[] X-Spam-Level: ******* X-Rspamd-Action: add header X-Spamd-Bar: +++++++ X-Rspamd-Server: hera X-Spam: Yes Received-SPF: pass client-ip=185.233.100.1; envelope-from=andreas@HIDDEN; helo=hera.aquilenet.fr X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_VALIDITY_CERTIFIED_BLOCKED=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Open bug to get number. Andreas
Andreas Enge <andreas@HIDDEN>:bug-guix@HIDDEN.
Full text available.bug-guix@HIDDEN:bug#77407; Package guix.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.