GNU bug report logs - #73316
Numeric user ID too large when generating the tarball

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: automake; Reported by: glorenzetti@HIDDEN; dated Tue, 17 Sep 2024 12:30:02 UTC; Maintainer for automake is bug-automake@HIDDEN.

Message received at 73316 <at> debbugs.gnu.org:


Received: (at 73316) by debbugs.gnu.org; 19 Sep 2024 16:00:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Sep 19 12:00:49 2024
Received: from localhost ([127.0.0.1]:33330 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1srJaL-0007hu-0S
	for submit <at> debbugs.gnu.org; Thu, 19 Sep 2024 12:00:49 -0400
Received: from mx07-006a4e02.pphosted.com ([143.55.146.78]:34946)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <glorenzetti@HIDDEN>) id 1srJaG-0007he-4g
 for 73316 <at> debbugs.gnu.org; Thu, 19 Sep 2024 12:00:47 -0400
Received: from pps.filterd (m0316690.ppops.net [127.0.0.1])
 by mx07-006a4e02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 48JBIrqK022078;
 Thu, 19 Sep 2024 18:00:25 +0200
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cefca.es; h=cc
 :content-transfer-encoding:content-type:date:from:in-reply-to
 :message-id:mime-version:references:subject:to; s=dkim3; bh=Cuo2
 2YZUiTMYsJaI2aqmeUtzMJKoQP3lhXZd5we4R4E=; b=vsNayRmGzV/EHAOAOv8n
 3bHhNCVYOe9yLCtZ9y6zqWZb7ZHSpyGme53JOEOeq2Gpp8bQ3Z32Z8Z7OjugB2FA
 ihfBOUf0V4BetYmcn2aOuGRCmxgtMhvOgFArtTroVzVAHjY5ejiu0Gl1W6mI0Vyz
 KkfJd8filR+qJA7f+zTfgbdMqjogQ2A3jQ0uYJosbodJzlrzbtknaoPb1RRdqLpG
 rvLJo90ZhNARZilTfzy+FLWLJoQf83ib69GmnN10t/xi+VLqg4GdzQnLsubJ/BjL
 IiMU/K3VegBDhbwsFBeqrXwnY8imurPw97GztFZJNmBN+A5FgA3jaAwNWiGQzOe2
 Kg==
Received: from cefca-vir-053.cefca.es ([193.146.122.33])
 by mx07-006a4e02.pphosted.com (PPS) with ESMTPS id 41nkum7ntk-1
 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT);
 Thu, 19 Sep 2024 18:00:25 +0200 (MEST)
Received: by cefca-vir-053.cefca.es (Postfix, from userid 33)
 id 945F980B02; Thu, 19 Sep 2024 18:00:23 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=cefca.es; s=dkim;
 t=1726761623; bh=3pyxDYbIFZF4Z9X55kSlhQAT1KZxAxffmV5jPouSXk0=;
 h=To:Subject:Date:From:Cc:In-Reply-To:References:From;
 b=AsvfFtWfM90LEw2LB7pWvvVR0Qxr8R69x65/4emYmA0Jc6HJwTwRpHNYEuznoHsgL
 Pg+r/WeI3f11A9lBHOx803kmvYBO1rkrD3oeFsyABS9KiR8LW5q31+piasFzzlMCZ4
 R/YHXX1oT2l88BFxf1ZD7LHt1uWRfeXOXJF8QDTg=
To: Karl Berry <karl@HIDDEN>
Subject: Re: bug#73316: Numeric user ID too large when generating the tarball
X-PHP-Originating-Script: 0:rcmail.php
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: 7bit
Date: Thu, 19 Sep 2024 18:00:23 +0200
From: glorenzetti@HIDDEN
In-Reply-To: <202409172140.48HLerDW209342@HIDDEN>
References: <202409172140.48HLerDW209342@HIDDEN>
Message-ID: <c4e24aee36ce6255bf49761f7057449c@HIDDEN>
X-Sender: glorenzetti@HIDDEN
User-Agent: Roundcube Webmail/0.9.5
X-Proofpoint-GUID: 4XuLNCeONlehqnhvBuyVoRtpbiy9mI2D
X-Proofpoint-ORIG-GUID: 4XuLNCeONlehqnhvBuyVoRtpbiy9mI2D
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.60.29
 definitions=2024-09-11_02,2024-09-09_02,2024-09-02_01
X-Proofpoint-Spam-Details: rule=salida_notspam policy=salida score=0
 suspectscore=0 spamscore=0
 mlxlogscore=999 clxscore=1011 priorityscore=1501 lowpriorityscore=0
 mlxscore=0 impostorscore=0 bulkscore=0 malwarescore=0 phishscore=0
 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.19.0-2408220000 definitions=main-2409190106
X-Spam-Score: -0.3 (/)
X-Debbugs-Envelope-To: 73316
Cc: 73316 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.3 (-)

Hi Karl,

thanks for the detailed answers.
We've run few more tests, and we've found a couple more issues.

1. As you pointed out, TAR_OPTIONS is working fine from the command 
line, but it doesn't work when written inside Makefile.am, neither on 
Mac, nor on Linux.
$ TAR_OPTIONS="--version"
$ export TAR_OPTIONS

2. The workaround we were attempting uses an AS_IF to initialize a 
variable to be used as argument in AM_INIT_AUTOMAKE, but 
AM_INIT_AUTOMAKE is reading that variable as an option. Are we missing 
something regarding the syntax of autotools?

3. Feature request: it would be nice to have a "tar-no-owner" option for 
AM_INIT_AUTOMAKE that sets user and group ids to 0. (The "privileges" 
issue apparently is only when extracting with --same-owner, so intended)

Best,
Giacomo




Information forwarded to bug-automake@HIDDEN:
bug#73316; Package automake. Full text available.

Message received at 73316 <at> debbugs.gnu.org:


Received: (at 73316) by debbugs.gnu.org; 17 Sep 2024 21:42:01 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Sep 17 17:42:01 2024
Received: from localhost ([127.0.0.1]:56149 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1sqfxQ-0007Sf-RZ
	for submit <at> debbugs.gnu.org; Tue, 17 Sep 2024 17:42:01 -0400
Received: from frenzy.freefriends.org ([198.99.81.75]:41234
 helo=freefriends.org) by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <karl@HIDDEN>) id 1sqfxP-0007SQ-3m
 for 73316 <at> debbugs.gnu.org; Tue, 17 Sep 2024 17:41:59 -0400
X-Envelope-From: karl@HIDDEN
Received: from freefriends.org (localhost [127.0.0.1])
 by freefriends.org (8.16.1/8.16.1) with ESMTPS id 48HLesrp209344
 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT);
 Tue, 17 Sep 2024 15:40:54 -0600
Received: (from apache@localhost)
 by freefriends.org (8.16.1/8.14.7/Submit) id 48HLerDW209342;
 Tue, 17 Sep 2024 15:40:53 -0600
Date: Tue, 17 Sep 2024 15:40:53 -0600
Message-Id: <202409172140.48HLerDW209342@HIDDEN>
From: Karl Berry <karl@HIDDEN>
To: glorenzetti@HIDDEN
Subject: Re: bug#73316: Numeric user ID too large when generating the tarball
In-Reply-To: <d492c664f2ebae796afcf68e5d0685a9@HIDDEN>
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 73316
Cc: 73316 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi Giacomo - thanks for the report. Unfortunately, I (still) don't see a
good way for Automake can automatically deal with this problem. After
reading the various links in your message, it seems even less feasible.

Automatically switching to tar-pax if the current id is too large feels
like too big of a change to me. The user might well want to fix it in
another way. I know I would.

Does tar report an error for you with a too-large-for-v7 uid value?
I get, e.g.,
$ tar -cf x.tar --owner=31863269 --format=v7 x.html
tar: value 31863269 out of uid_t range 0..2097151
tar: Exiting with failure status due to previous errors

So I don't see anything to be gained by automake trying to detect the
situation just to issue a different error.

All I can see to do is to add tar-pax as another workaround for the
problem in the manual. (Glad you had that idea.)

*

Regarding "privileges" needed for --owner=0 --group=0, as you reported
in https://savannah.gnu.org/bugs/?65578#comment5 ... that seems
strange. It's just writing a file with certain bits. It does not happen
for me with GNU tar 1.34 (compiled from the original source).

But given that that was the case for you, that's another argument for
automake not to try to do anything automatically. For instance, you
could (hopefully) use --owner=1 --group=1 instead, if your tar somehow
does something special about [ug]id 0.

*

Regarding the TAR_OPTIONS envvar, it works for me with the
same tar 1.34:

$ TAR_OPTIONS=-v tar cf test.tar test.txt
test.txt

So I don't know why it didn't work for you. Puzzling.

Happy hacking,
Karl






Information forwarded to bug-automake@HIDDEN:
bug#73316; Package automake. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 17 Sep 2024 12:29:14 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Sep 17 08:29:14 2024
Received: from localhost ([127.0.0.1]:54172 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1sqXKT-0001EM-Eq
	for submit <at> debbugs.gnu.org; Tue, 17 Sep 2024 08:29:14 -0400
Received: from lists.gnu.org ([209.51.188.17]:58038)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <glorenzetti@HIDDEN>) id 1sqTfO-0004ti-2a
 for submit <at> debbugs.gnu.org; Tue, 17 Sep 2024 04:34:35 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <glorenzetti@HIDDEN>)
 id 1sqTf8-000894-7B
 for bug-automake@HIDDEN; Tue, 17 Sep 2024 04:34:19 -0400
Received: from mx08-006a4e02.pphosted.com ([143.55.148.243])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <glorenzetti@HIDDEN>)
 id 1sqTf5-0005eW-Fv
 for bug-automake@HIDDEN; Tue, 17 Sep 2024 04:34:17 -0400
Received: from pps.filterd (m0316697.ppops.net [127.0.0.1])
 by m0316697.ppops.net (8.18.1.2/8.18.1.2) with ESMTP id 48H4KipH022073
 for <bug-automake@HIDDEN>; Tue, 17 Sep 2024 10:34:02 +0200
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cefca.es; h=
 content-transfer-encoding:content-type:date:from:message-id
 :mime-version:subject:to; s=dkim3; bh=MH1iVwStWjROGdagJtgc4Ssc0R
 MrceuK4RzKgMRrwiI=; b=NCYxYsZCjFw8j8+ZkwmmZOP7HImj7i0CwvBqK9v7IB
 uMvyAeokLlcaGTds4xX/ZaOtcGUKZlYNQY6Tt9rfxLOY0tX4s5PW8G1AndENhK45
 uowQR7NJz8NQe2ig4yIHfhw32/e9lPxaqt8CDw9luqeTDWSxmFdYBL4GGM8tBlG/
 OpF9Wr6gyWe2GypsqBzVXsgyGIv6XLejiT1FLDOJUPbaDEBILz8ecwdYcAM9DRwv
 4bl3xj49qUWpJay74vEio9aW4y1uAfdT7e0AZUYdWUeqdKlGpLd+LjtGTA8sic+V
 7QzBkqZpumMWMXv6X7J+92/PvFROmO0CXsj8WTvbH1PA==
Received: from cefca-vir-053.cefca.es ([193.146.122.33])
 by m0316697.ppops.net (PPS) with ESMTPS id 41nmh599ab-1
 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT)
 for <bug-automake@HIDDEN>; Tue, 17 Sep 2024 10:34:02 +0200 (MEST)
Received: by cefca-vir-053.cefca.es (Postfix, from userid 33)
 id AE91580AEF; Tue, 17 Sep 2024 10:34:01 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=cefca.es; s=dkim;
 t=1726562041; bh=OKgkr4XvMybK3nZj6MBCQR+Pl7wajV/QaV3GCDFa7ZA=;
 h=To:Subject:Date:From:From;
 b=w6uvNOtnjAxZ+fYyI+ctIiATIgsuQU95WgaEuJ3YqC5V2bq3LflmxApSs//kuBjZs
 MITl5mVFzBCzxiuUSbNKS4cLRw6NC2MsoS9CrQt+4PMVVfZSxFKVEgAxpLV8fQbT96
 k6wXqXY8AsAqJIuWR28RLsiP3ixTsT4veIGJpobc=
To: bug-automake@HIDDEN
Subject: Numeric user ID too large when generating the tarball
X-PHP-Originating-Script: 0:rcmail.php
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: 7bit
Date: Tue, 17 Sep 2024 10:34:01 +0200
From: glorenzetti@HIDDEN
Message-ID: <d492c664f2ebae796afcf68e5d0685a9@HIDDEN>
X-Sender: glorenzetti@HIDDEN
User-Agent: Roundcube Webmail/0.9.5
X-Proofpoint-GUID: mVOtq6Rsdp3s9Zig5CHWuMxifSryCHZ9
X-Proofpoint-ORIG-GUID: mVOtq6Rsdp3s9Zig5CHWuMxifSryCHZ9
X-Proofpoint-Virus-Version: vendor=baseguard
 engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.60.29
 definitions=2024-09-11_02,2024-09-09_02,2024-09-02_01
X-Proofpoint-Spam-Details: rule=salida_notspam policy=salida score=0
 spamscore=0 clxscore=1011
 priorityscore=1501 mlxscore=0 adultscore=0 suspectscore=0 mlxlogscore=509
 phishscore=0 impostorscore=0 lowpriorityscore=0 bulkscore=0 malwarescore=0
 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2408220000
 definitions=main-2409170063
Received-SPF: pass client-ip=143.55.148.243; envelope-from=glorenzetti@HIDDEN;
 helo=mx08-006a4e02.pphosted.com
X-Spam_score_int: -28
X-Spam_score: -2.9
X-Spam_bar: --
X-Spam_report: (-2.9 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-1.048, RDNS_DYNAMIC=0.982,
 SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.3 (-)
X-Debbugs-Envelope-To: submit
X-Mailman-Approved-At: Tue, 17 Sep 2024 08:29:12 -0400
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Good morning,

GNU Astronomy Utilities (Gnuastro) uses GNU Autotools. A Gnuastro 
developer encountered the "Numeric user ID too large" error when 
generating a tarball with the 'make dist' command on his macOS (Monterey 
12.3) laptop. His user id is an integer with 9 digits, which is too big 
for the old v7 and ustar formats of tar.

The issue is discussed in Gnuastro's bug tracker 
(https://savannah.gnu.org/bugs/?65578), where the work-around conclusion 
was to use a conditional that adds 'tar-pax' to 'AM_INIT_AUTOMAKE' when 
the user ID is so large. For reference, here is Gnuastro's configure.ac: 
https://git.savannah.gnu.org/cgit/gnuastro.git/tree/configure.ac#n44
The issue was also erroneusly reported in autoconf's bug tracker 
(https://savannah.gnu.org/support/?111123).

Even though we encountered this problem in macOS, this problem may not 
be limited to it. Other user management systems who use such large IDs 
may also cause this issue.

While it is possible to write such workaround downstream in Gnuastro, it 
would be nice to have the issue solved upstream in the GNU Autotools 
since it can happen for any other developer of other software that uses 
Autotools.

Best Regards,
Giacomo Lorenzetti




Acknowledgement sent to glorenzetti@HIDDEN:
New bug report received and forwarded. Copy sent to bug-automake@HIDDEN. Full text available.
Report forwarded to bug-automake@HIDDEN:
bug#73316; Package automake. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 12 Jan 2025 05:45:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.