[ExtractStream] more than 2 gigs extracted = not possible on linux?

Steven Webb steve at b...
Mon, 27 Aug 2001 15:20:53 -0600 (MDT)


I'm running the "woody" distribution of debian and I can't get the "head"
command to act any different:

(20) swebb@s... Mon 3:12pm [/d1] % head -c 3000000000 /dev/zero > bigfile
head: write error: File too large
2.450u 36.240s 1:48.38 35.6% 0+0k 0+0io 111pf+0w

I *AM* running the 2.2 kernel and ext2 filesystem though.

More info:
(24) swebb@s... Mon 3:17pm [/d1] % ldd /usr/bin/head
libc.so.6 => /lib/libc.so.6 (0x40016000)
/lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0x40000000)
(26) swebb@s... Mon 3:17pm [/d1] % md5sum /usr/bin/head
5988d44c7391c13c0e00dd04d3d02370 /usr/bin/head

... perhaps this is a fairly recent addition to woody - I'll run an
"update" and see what happens. 8)

- Steve

On Mon, 27 Aug 2001 sharkey@a... wrote:

> Date: Mon, 27 Aug 2001 17:03:47 -0400
> From: sharkey@a...
> Reply-To: ExtractStream@yahoogroups.com
> To: ExtractStream@yahoogroups.com
> Subject: Re: [ExtractStream] more than 2 gigs extracted = not possible on
linux?
> 
> > > > It's not a kernel/OS issue, it's an application/libc issue.
> > > 
> > > Actually, it's a kernel/filesystem issue. A 32 bit machine implicitly
> > > limits the maximum file size under linux, but certain filesystems allow for
> > > workarounds. I've seen Oracle on reiser with success.
> > 
> > Hmmm. I seem to have read this as well. I thought that the ext2
> > filesystem was the problem here (as well as the OS and other things). If
> > I use "touch" I still cannon create a file > 2 Gigs. If I just "cat
> > /dev/zero > /big/bigfile" it will still fail when the 2 Gig filesize is
> > reached.
> > 
> > (4) swebb@s... Mon 2:44pm [/d1] % cat /dev/zero > bigfile
> > cat: write error: File too large
> 
> Remember, "cat" is an application. At least in my distribution (Debian),
> cat has not yet been coded for large file support, but "head" has been.
> Go figure.
> 
> box% head -c 3000000000 /dev/zero > bigfile
> box% ls -la bigfile
> -rw-r--r-- 1 sharkey sharkey 3000000000 Aug 27 17:01 bigfile
> box% ls -lah bigfile
> -rw-r--r-- 1 sharkey sharkey 2.8G Aug 27 17:01 bigfile
> box% 
> 
> Thats on a standard ext2 partition.
> 
> The 2GB limit is purely at the application/libc level.
> 
> Eric
> 
> 
> To unsubscribe from this group, send an email to:
> ExtractStream-unsubscribe@yahoogroups.com
> 
> 
> 
> Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/ 
> 
> 

--
EMAIL: (h) steve@b... WEB: http://badcheese.com/~steve
(w) swebb@r...
stevewebb@m...