OCR Tips: Difference between revisions

Jump to navigation Jump to search
684 bytes added ,  3 January 2014
no edit summary
No edit summary
No edit summary
 
(20 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= FineReader tips  =
= '''FineReader Tips''' =


==== '''What works best:''' ====
== What works best:  ==


'''Size, Color/Grayscale, and Resolution:'''<br>  
*'''Recommended Image Resolution:''' 300 dpi for typical texts (printed in fonts of size 10pt or larger), 400–600 dpi for texts printed in smaller fonts (9pt or smaller). For best OCR results vertical and horizontal resolutions must be the same. See [http://finereader.abbyy.com/guide/ User's Guide] for additional information.
*'''Fullsize, color JPEG''' images of herbarium specimens are ±7-15 MB in size and take about 2 minutes to process each.
*'''Fullsize, grayscale JPEG''' images of herbarium specimens are ±1 MB in size and take about 1 minute to process each.
*'''Cropped JPEG''' images containing only the primary plant collection label are about 300-600 KB in size and take 6-10 seconds to process each.<br>


Recommended Image Resolution: 300 dpi for typical texts (printed in fonts of size 10pt or larger), 400–600 dpi for texts printed in smaller fonts (9pt or smaller). For best OCR results vertical and horizontal resolutions must be the same. See [http://finereader.abbyy.com/guide/ User's Guide] for additional information.<br>
== What to look out for: ==


*Fullsize, color JPEG images of herbarium specimens are ±7-15 MB in size and take about 2 minutes to process each.  
*Setting the resolution over 600 dpi increases the recognition time. Increasing the resolution does not yield substantially improved recognition results. Setting an extremely low resolution (less than 150 dpi) adversely affects OCR quality. See [http://finereader.abbyy.com/guide/ User's Guide] for additional information.  
*Fullsize, grayscale JPEG images of full herbarium sheets are about 1 MB in size and take about 1 minute to process each.  
*'''Pattern training:''' If using this tool, be sure to train the tool on an image that is the same resolution as the other images you wish to OCR. This tool can be useful when running the software on many labels with the same format/fonts.  
*Cropped JPEG images containing primary collection label only are about 300-600 KB in size and take 6-10 seconds to process each.<br>
*'''Hot Folder: '''Using the Hot Folder allows for running the OCR software on batches of images. However, it does not scan barcodes in an image, only human-readable tex. When running the software on individual images (i.e. not using the Hot Folder), one can select to scan the barcode, as well as detect human-readable text.


==== '''What to look out for:'''<br>  ====
= '''Recognition Server Tips''' =


*Setting the resolution too high (over 600 dpi) increases the recognition time, as does . Increasing the resolution does not yield substantially improved recognition results. Setting an extremely low resolution (less than 150 dpi) adversely affects OCR quality. See [http://finereader.abbyy.com/guide/ User's Guide] for additional information.
== What works best: ==


*'''Pattern training:''' If using this tool, be sure to train the tool on an image that is the same resolution as the other images you wish to OCR. This tool can be useful when running the software on many labels with the same format/fonts.
EH: start with fewer languages selected since each language adds to the time taken (potential to sort specimens geographically prior to OCR). We are currently processing our specimens from SW Asia and the Middle East with a large number from Turkey so we currently run ABBYY with Turkish and English selected.<br> EH: we select high quality rather than speed<br>


*'''Hot Folder: '''Using the Hot Folder allows for running the OCR software on batches of images. However, it does not scan barcodes in an image, only human-readable tex. When running the software on individual images (i.e. not using the Hot Folder), one can select to scan the barcode, as well as detect human-readable text.
PL: OCR quality can be enhanced when a large image is cropped - which also reduces page count.<br> PL: Images can be ingested from a shared folder, or scan station, or ftp/ftps, or API. Hotfolder ingestion can be further controlled by including an optional XML ticket. XML tickets control workflow, output, and allow metadata to be ingested along with the image to be processed.<br>


== Recognition Server ==
== What to look out for: ==


ABBYY Effective Practices &amp; Hints for users of Recognition Server - what works best in our experiences.  
EH: we find that running the whole image increases the page count, each image ends up as 4-6 pages. Not necessarily a problem but good to be aware of if page count is an issue.<br><br>


EH: start with fewer languages selected since each language adds to the time taken (potential to sort specimens geographically prior to OCR). We are currently processing our specimens from SW Asia and the Middle East with a large number from Turkey so we currently run ABBYY with Turkish and English selected.<br> EH: we select high quality rather than speed<br>
= '''Tesseract Tips''' =


PL: OCR quality can be enhanced when a large image is cropped - which also reduces page count.<br> PL: Images can be ingested from a shared folder, or scan station, or ftp/ftps, or API. Hotfolder ingestion can be further controlled by including an optional XML ticket. XML tickets control workflow, output, and allow metadata to be ingested along with the image to be processed.<br>
== What works best: ==


- what to look out for (with examples).
Resolution: x-height (pixel height of lowercase letter) between 20-40 pixels is ideal<br> Switching to grayscale, increasing contrast, and other image treatments can improve output at times


EH: we find that running the whole image increases the page count, each image ends up as 4-6 pages. Not necessarily a problem but good to be aware of if page count is an issue.<br><br>
== What to look out for: ==


== Tesseract Tips  ==
Resolution: an x-height below 8-12 pixels will produce very poor OCR return <br> Using a black background for package labels (e.g. lichens, bryophyte) will create a black border that can significantly reduce OCR return<br> Form labels can interfere with OCR output<br> Faded labels or images with poor lighting can be problematic<br> Old font can be problematic. However, it is possible to train Tesseract for new fonts


Tesseract Effective Practices &amp; Hints.
== Fixing errors: ==


<br>What works best:
Tesseract makes characteristic errors. Some of these such as "\/\/" or "\X/" substituted for for "W" can be be globally replaced as it is highly unlikely that they would occur on their own on a label. Others such as "O" substituted for "0", "1" or "!" substituted for "l" or "Z" substituted for "2" or visa versa can be replaced in a context-dependent manner in dates, latitudes and longitudes, etc. For instance, a string containing multiple errors such as "0ct.&nbsp;!Z, ZOlZ" can be programmatically located with a regular expression and changed to "Oct. 12, 2012" or even "12-October-2012" so that it can be entered into a database.


Resolution: x-height (pixel height of lowercase letter) between 20-40 pixels is ideal<br> Switching to grayscale, increasing contrast, and other image treatments can improve output at times
== Misc notes: ==


<br>What to look out for:
Will often recognize vertical text<br> Image input can be tif, jpeg, or gif<br>  


Resolution: an x-height below 8-12 pixels will produce very poor OCR return <br> Using a black background for package labels (e.g. lichens, bryophyte) will create a black border that can significantly reduce OCR return<br> Form labels can interfere with OCR output<br> Faded labels or images with poor lighting can be problematic<br> Old font can be problematic. However, it is possible to train Tesseract for new fonts
= '''Omnipage features''' =
== Advantages of Omnipage  ==


<br>Fixing errors:
*Very good OCR accuracy
*Converted documents e.g. pdf-files look exactly like the original. Similar fonts.
*Supports output formats including XML, PDF, HTML, Microsoft Word, plus many more formats.
*Provides location (coordinates) of recognized words.
*Batch processing with 4 cores.
*Schedule large volumes of files for batch processing from folders.
*Recognises over 120 languages.
*Price from $149.00 (standard) to $499.00 (professional)


Tesseract makes characteristic errors.  Some of these such as "\/\/" or "\X/" substituted for for "W" can be
== Disadvantages ==
be globally replaced as it is highly unlikely that they would occur on their own on a label.  Others such as "O" substituted for "0", "1" or "!" substituted for "l" or "Z" substituted for "2" or visa versa can be replaced in a context-dependent manner in dates, latitudes and longitudes, etc.  For instance, a string containing multiple errors such as "0ct. !Z, ZOlZ" can be programmatically located with a regular expression and changed to "Oct. 12, 2012" or even "12-October-2012" so that it can be entered into a database.


<br>Misc notes:
*is limited to images of 8600 lines
*Omnipage SDK estimated $6000.00


Will often recognize vertical text<br> Image input can be tif, jpeg, or gif
= '''Source of page contents''' =
Notes on these pages are compiled from the cumulative experiences of the iDigBio Augmenting OCR Working Group and the natural history collections community members contributing their collective knowledge for the benefit of all.
5,887

edits

Navigation menu