Re: DOCBOOK-APPS: Xalan & Big Files & Chunking...

[Norman Walsh <ndw@nwalsh.com>]

/ Michael Cortez <mcortez@fullcoll.edu> was heard to say:
| I have some huge XML files that I'm processing (3mb) and discovered that
| Xalan tends to blow up if I process the entire file at once.  So I broke it
| up into three smaller files, that I can successfully process with the
| autoidx.xsl to produce three large HTML files.
| 
| I would rather Chunk it, so I tried substituting the chunk.xsl file for my
| autoidx.xsl on the command line, and now it just, uh, twiddles it's thumbs?
| Xalan fires up and sucks up CPU & memory, but never exits (I waited an hour,
| when I processed w/ autoidx it took about one minute) and doesn't produce
| any output files...

You're using autoidx.xsl on a roughly 1mb file with XalanJ and it
finishes in about a minute? That's staggeringly good performance.

| Any help / suggestions would be greatly appreciated...

Have you tried any of the debugging options? You might also put in
some xsl:messages in places like the root template and maybe the book
template to see if it ever gets started.

How much real memory does your machine have? I was going to suggest
that it might be thrashing, but if it does the single files quickly,
I can't see why it wouldn't do the chunks almost as quickly.

                                        Be seeing you,
                                          norm

-- 
Norman Walsh <ndw@nwalsh.com>      | Even while a thing is in the act
http://www.oasis-open.org/docbook/ | of coming into existence, some
Chair, DocBook Technical Committee | part of it has already ceased to
                                   | be.--Marcus Aurelius