ImageMagick转换内存不足(ImageMagick convert out of memory)

 我有一个自定义应用程序在CentOS 6.7上运行，带有64 GB的RAM，它基本上是一个文件爬虫，每当它找到一个匹配某些文件扩展名的文件（主要是TIFF或多页TIFF）时调用以下bash脚本。 我无法确切地说出频率和已考虑的文件数量，但它的数量级是数千。 
 
#!/bin/bash

IMAGE_INPUT=$1
OUTPUT=$2
TMP_FOLDER=/data/tesseract-tmp

# generating a unique random file name
TFN=`cat /dev/urandom | tr -cd 'a-f0-9' | head -c 32`;
# converting the image and putting the result into the TFN
/usr/bin/convert -density 288 "$IMAGE_INPUT" -resize 75% -quality 100 -append jpeg:$TMP_FOLDER/$TFN;
# extract text with tesseract and put it into a result file
/usr/local/bin/tesseract $TMP_FOLDER/$TFN $TMP_FOLDER/$TFN.out;
cp $TMP_FOLDER/$TFN.out.txt $OUTPUT;
# returning the file content to std output
cat $OUTPUT;
 
 临时文件正由cronjob清理。 
 
 我注意到经过一段时间和大量的脚本调用后，top命令向我显示imagemagick的gs和转换进程占用了所有可用的内存，并且它们开始消耗所有可用的交换空间。 如果我不杀死这些进程，系统会耗尽内存并冻结。 
 
 我该如何解决这种情况？ 有没有办法限制特定程序（转换）的内存量，还是有可能将执行调用队列排队到脚本？ 
 
 注意我已经看到转换命令有限制选项，但如果我理解正确，它适用于正在运行的进程的单个实例，而我想限制整个运行实例的内存使用。 
 
 谢谢 

I have a custom application runnning on CentOS 6.7 with 64 GB of RAM, which is basically a file crawler that calls the following bash script every time it finds a file matching some file extensions(mainly TIFFs or multipage TIFFs). I can't tell exactly the frequency and how many files are been considered, but it's in the order of thousands.
 
#!/bin/bash

IMAGE_INPUT=$1
OUTPUT=$2
TMP_FOLDER=/data/tesseract-tmp

# generating a unique random file name
TFN=`cat /dev/urandom | tr -cd 'a-f0-9' | head -c 32`;
# converting the image and putting the result into the TFN
/usr/bin/convert -density 288 "$IMAGE_INPUT" -resize 75% -quality 100 -append jpeg:$TMP_FOLDER/$TFN;
# extract text with tesseract and put it into a result file
/usr/local/bin/tesseract $TMP_FOLDER/$TFN $TMP_FOLDER/$TFN.out;
cp $TMP_FOLDER/$TFN.out.txt $OUTPUT;
# returning the file content to std output
cat $OUTPUT;
 
The temp files are being cleaned by a cronjob.
 
I have noticed that after some time and a lot of calls to the script, the top command shows me that the gs and convert processes of imagemagick are taking all the memory available, and they start to consume all the swap space available. If I don't kill those processes the system runs out of memory and freezes.
 
How can I solve this situation? Is there a way to limit the amount of memory for a particular program(convert) or is there the possibility to queue the execution of calls to the script?
 
N.B. I have seen that there is the limit option for the convert command, but if I'm understanding right, it applies to the single instance of the running process, while I would like to limit the memory usage for the whole running instances.
 
Thanks

原文：https://stackoverflow.com/questions/48423113