[ExtractStream] more than 2 gigs extracted = not possible on linux?

Barcinski, Andy andy at a...
Mon, 27 Aug 2001 16:20:13 -0500


> The linux kernel with a standard ext2 filesystem fully 
> supports >2GB files.
> I've used them several times.

I apologize for this -- it was confusion. You didn't use the word
'filesystem' in your original post, and I read it wrong. My fault.

> 
> > A 32 bit machine implicitly
> > limits the maximum file size under linux
> 
> Wrong. Try it yourself.

fs/ext2/file.c (2.4.8-ac something, I think)

/*
* Called when an inode is about to be open.
* We use this to disallow opening RW large files on 32bit systems if
* the caller didn't specify O_LARGEFILE. On 64bit systems we force
* on this flag in sys_open.
*/
static int ext2_open_file (struct inode * inode, struct file * filp)
{
if (!(filp->f_flags & O_LARGEFILE) &&
inode->i_size > 0x7FFFFFFFLL)
return -EFBIG;
return 0;
} 

After actually looking at the code(duh...), I see that i_size is a loff_t,
which is a 64 bit member. Perhaps someone can change extractstream/et al.
to use O_LARGEFILE on open. My tivonet is in the mail, and when I get it
hooked up, perhaps I'll play with this. I haven't looked at it closely, so
it might not be feasible. Check include/fs.c for struct inode definitions,
and /usr/include/bits/types.h for the loff_t declaration for those of you
interested.

> > but certain filesystems allow for
> > workarounds. I've seen Oracle on reiser with success.
> 
> Most large data base packages like Oracle don't use 
> filesystems at all,
> they store their database information on a raw, unformatted partition.
> (Although they can use filesystems if you want to set them up 
> that way.)

There are lots of reasons to use filesystems over raw (and vice versa).
This 
isn't an Oracle list, so I won't go into it. Suffice it to say, I do Oracle

DBA work (among other things) and have weighed these against each other many
times.

> This is out of date. Note the caption "and once the 2.4 
> kernels come out".
> 

I think I need to go drink some more coffee. I apologize for my errors.

> Eric
> 
> ------------------------ Yahoo! Groups Sponsor 
> ---------------------~-->
> Secure all your Web servers now: Get your FREE Guide and 
> learn to: DEPLOY THE LATEST ENCRYPTION,
> DELIVER TRANSPARENT PROTECTION, and More!
> http://us.click.yahoo.com/VihfLB/nT7CAA/yigFAA/CDr1lB/TM
> --------------------------------------------------------------
> -------~->
> 
> To unsubscribe from this group, send an email to:
> ExtractStream-unsubscribe@yahoogroups.com
> 
> 
> 
> Your use of Yahoo! Groups is subject to 
> http://docs.yahoo.com/info/terms/ 
> 
>