I had a process that was failing when creating a large PDF file. I turned in a support request and the conclusion was that PlanetPress was running out of memory. So, I am splitting the data file into approximately 1,000 page chunks. When I let PP process a single file or maybe 5 or 10 files, it runs fine. But, when I generate 15-25 files and let PP process all of them, many of the PDF's that are generated are corrupt. So, I then take the exact same data file chunks, and "feed" them to PP one at a time and it works fine. This happens quite frequently so I am now going to write another program that splits the data file into chunks, waits for Planetpress to convert each chunk to PDF, then sends the next chunk. This seems like such a waste of programming effort and defeats the whole purpose of the mult-threaded process of PP. Does anyone have a better idea?

I am using 7.1.3.5223

Thank You,
Brandon

Hi Brandon:

Create multiple copies of your process. You can then split your incoming file between the copies. each process uses its own version of the PlanetPress document, which should minimse/eliminate the errors reported by the process.

Please contact our technical support if you need assistance to set this up.

Regards,

I created 25 processes to monitor 25 separate folders in PP Watch. I setup a "distributor" process with a vbscript to take the 25 data files and drop each one into a separate folder. The processor jumped to 100% while the PDF's were generating. After they were done, about 50% of the files were corrupt.

Next I take the same 25 files. I put a few into the folders one at a time. I wait for the PDF's to generate. Then I drop a few more in the folders. All PDF's come out fine.

There has to be a memory issue or something with watch that prevents it from working properly.

Thank You,
Brandon

Hi BWW,

I feel like the issue could lie somewhere else, as PlanetPress Image with the multi-threading is very intensely used around the world by tons of customers and we haven't had any similar feedback before. I personally am a Project Developer for OL and use it daily without facing this issue, but that doesn't mean there is no issue, it just makes it very unlikely.

Here is the way I understand how PlanetPress works.

First of all, the way the multithreading works with PlanetPress image, you cannot get more threads than the amount of processor cores your server has. For example, if you have a quad core machine, you will not get any benefit from splitting your files into more than 4 parallel processes. Also, PlanetPress Image doesn't benefit much from parallel processing because there is just one queue for jobs anyway in its working folders. Unless you perform other actions that would benefit from this parallel processing before PPImage in your processes, it is not really profitable.

I suggest you open a support call so our techs can have a look at your setup and help you find the issue.

Regards,

Olivier

I located the following error in the log file...

DEBUG: Producing an Optimized PostScript document...
ERROR: PTK0215 : Error evaluating resource type for c:\data\xdp\archive\27672\customer files\INV-214479.pdf: The Alambic server crashed while reading the output and will be restarted. Please try again. (Error reading from server: Error code 109: The pipe has bee with line showPDF(&pdffilename,&pdfpagenum,&width,&height)
ERROR: W3001 : Error while executing plugin: An error occurred while producing the PostScript job.
ERROR: Create PDF: W1603 : Plugin failed - 10:34:33

Obviously there is nothing wrong with the file INV-214479.pdf, but there is 3,174 PDF's in the folder. I am sure that is part of the issue. Any more ideas?