[ExtractStream] more than 2 gigs extracted = not possible on linux?

[Barcinski, Andy]

> It's not a kernel/OS issue, it's an
> application/libc issue.

Actually, it's a kernel/filesystem issue. A 32 bit machine implicitly
limits the maximum file size under linux, but certain filesystems allow for
workarounds. I've seen Oracle on reiser with success.

Check out the paper at http://www.linuxgazette.com/issue55/florido.html. It
pits a few (journaling) filesystems against each other. There's a bright
Teal box, under "Solving the inability" that gives some intersting
information.

As a fix for now, use ReiserFS. It's stable and a much better performer
than ext2 (unless, of course, you get a distro that has debugging turned on
in the fs code. You don't use a default kernel now, do you? :-) ).


> -----Original Message-----
> From: sharkey@a...
> [mailto:sharkey@a...]
> Sent: Monday, August 27, 2001 1:38 PM
> To: ExtractStream@yahoogroups.com
> Subject: Re: [ExtractStream] more than 2 gigs extracted = not possible
> on linux?
> 
> 
> Sent by 
> mailto:sentto-3437393-291-998938918-andy=americantv.com@r...
> s.onelist.com
> ______________________________________________
> 
> > I'm using extractstream to pull video from my tivo to a 
> linux machine.
> > I've had the stream stopped many times and I've found that 
> there's a 2 gig
> > file size maximum on linux,
> 
> This is not true. Well, not exactly true anyway.
> 
> "linux" has full support for >2GB files. However, many 
> programs designed
> to run on (i386) Linux use 32 bit file pointers, and these 
> programs will
> not work properly with large files. They need to be recoded to use
> 64 bit file pointers instead. It's not a kernel/OS issue, it's an
> application/libc issue.
> 
> > Highest quality that's over an hour, it isnot possible to 
> extract it into
> > a single file. Anyone find a way around this other than 
> just record at
> > lower quality settings?
> 
> There are four ways around this. You can:
> 
> 1) Re-code the application to use 64-bit file pointers.
> 2) Upgrade to a 64-bit native platform (e.g. Alpha or Ultrasparc)
> 3) Find a new application which already has 64-bit file pointer
> support (I think Broadcast 2000 does).
> 4) If your application doesn't require seeking, use named pipes.
> Use cat or head to dump data into a named pipe and read from the
> pipe with your application.
> 
> Eric
> 
> ------------------------ Yahoo! Groups Sponsor 
> ---------------------~-->
> Secure all your Web servers now: Get your FREE Guide and 
> learn to: DEPLOY THE LATEST ENCRYPTION,
> DELIVER TRANSPARENT PROTECTION, and More!
> http://us.click.yahoo.com/VihfLB/nT7CAA/yigFAA/CDr1lB/TM
> --------------------------------------------------------------
> -------~->
> 
> To unsubscribe from this group, send an email to:
> ExtractStream-unsubscribe@yahoogroups.com
> 
> 
> 
> Your use of Yahoo! Groups is subject to 
http://docs.yahoo.com/info/terms/