Dataset Errata: Difference between revisions

Jump to navigation Jump to search

Dataset Errata (view source)

Revision as of 16:35, 3 July 2013

4,051 bytes removed ,  3 July 2013
m
→‎Parse file errors
Line 733: Line 733:
<br>
<br>


== Parse file errors  ==


::Inconsistency in Gold Parsed decimalLatitude and decimalLongitude in many labels. All omitted from NYBG lichens and Tennesee lichens. Gold Parsed WIS-L-0011728_lg.csv has decimalLatitude &amp; decimalLongitude rounded to 3 decimal digits (e.g. 60.467). WIS-L-0011729_lg.csv has decimalLatitude rounded to 2 decimal digits (60.15), decimalLongitude rounded to 1 decimal digit (-152.6). Typical of variations found throughout the files. It's possible that trailing zeros were just stripped off, but this inconsistency makes it impossible to match all the labels with a parsing program.
::::'''Alex will change the metrics to avoid counting off for stripped trailing zeroes'''. --[[User:Dpaul|Dpaul]] 15:36, 27 February 2013 (EST)
::Inconsistency in capitalization of verbatim fields in many Gold Parsed lichens. Example: NY01075763_lg.csv. In the label and OCR text the county is capitalized as ST. FRANCOIS, but in NY01075763_lg.csv it is title case: St. Francois. The state MISSOURI is capitalized in both the .txt and the .csv file. The scoring program is case sensitive, so any difference between the gold .csv and the program generated .csv will be marked wrong.
::::'''Alex will change the metrics to be case-insensitive'''. --[[User:Dpaul|Dpaul]] 17:28, 26 February 2013 (EST)
::Gold Parsed NY01075759_lg.csv: verbatimEventDate is 1998-04-19, should be 19 April 1998.
::::/home/aocr/datasets/lichens/gold/parsed/human/NY01075759_lg.csv fixed --[[User:Dpaul|Dpaul]] 18:06, 26 February 2013 (EST)
::::/home/aocr/datasets/lichens/silver/parsed/human/NY01075759_lg.csv fixed --[[User:Dpaul|Dpaul]] 18:06, 26 February 2013 (EST)
::::/webroot/datasets/lichens/gold/parsed/NY01075759_lg.csv fixed --[[User:Dpaul|Dpaul]] 17:35, 27 February 2013 (EST)
::Gold Parsed NY01075759_lg.csv: eventDate is 4/19/1998, should be 1998-04-19 according to Darwin Core (http://rs.tdwg.org/dwc/terms/#eventDate).
::::/home/aocr/datasets/lichens/gold/parsed/human/NY01075759_lg.csv fixed --[[User:Dpaul|Dpaul]] 18:06, 26 February 2013 (EST)
::::/home/aocr/datasets/lichens/silver/parsed/human/NY01075759_lg.csv fixed --[[User:Dpaul|Dpaul]] 18:06, 26 February 2013 (EST)
::::/webroot/datasets/lichens/gold/parsed/NY01075759_lg.csv fixed --[[User:Dpaul|Dpaul]] 17:35, 27 February 2013 (EST)
::::/webroot/datasets/lichens/silver/parsed/NY01075759_lg.csv okay --[[User:Dpaul|Dpaul]] 17:35, 27 February 2013 (EST)
::Gold Parsed NY01075770_lg.csv omits collector number, but should be 852.
::::/home/aocr/datasets/lichens/gold/parsed/human/NY01075770_lg.csv fixed --[[User:Dpaul|Dpaul]] 18:18, 26 February 2013 (EST)
::::/webroot/datasets/lichens/gold/parsed/NY01075770_lg.csv fixed --[[User:Dpaul|Dpaul]] 17:38, 27 February 2013 (EST)
::Gold OCR NY01075786_lg.txt has "(Ach.) Mil'll. Arg.", but on the image label it is "(Ach.) Müll. Arg." This error is carried to the Gold Parsed .csv file (which should be corrected if the .txt file is corrected).
::::/home/aocr/datasets/lichens/gold/outputs/human/NY01075786_lg.txt fixed --[[User:Dpaul|Dpaul]] 18:28, 26 February 2013 (EST)
::::/home/aocr/datasets/lichens/gold/parsed/human/NY01075786_lg.csv fixed --[[User:Dpaul|Dpaul]] 18:28, 26 February 2013 (EST)
::::/webroot/datasets/lichens/gold/parsed/NY01075786_lg.csv fixed --[[User:Dpaul|Dpaul]] 17:52, 27 February 2013 (EST)
::::/webroot/datasets/lichens/gold/ocr/NY01075786_lg.txt fixed --[[User:Dpaul|Dpaul]] 17:52, 27 February 2013 (EST)
<br>
::Label image NY01075760_lg.jpg had a spec of dirt next to "F. Berger", introducing an apostrophe as "Kocourkova &amp; 'F. Berger" in the Gold OCR. Gold Parsed NY01075760_lg.csv corrected "Kocourkova &amp; 'F. Berger" back to "Kocourkova &amp; F. Berger", omitting the apostrophe. Probably a valid correction, but not in a verbatim field.
::::/home/aocr/webroot/datasets/lichens/gold/parsed/NY01075760_lg.csv changed gold parsed aocr:verbatimScientificName to include the apostrophe to be consistent for verbatim field. fixed --[[User:Dpaul|Dpaul]] 16:06, 27 February 2013 (EST)


Back to the [https://www.idigbio.org/wiki/index.php/2013_AOCR_Hackathon_Wiki Hackathon Wiki]
Back to the [https://www.idigbio.org/wiki/index.php/2013_AOCR_Hackathon_Wiki Hackathon Wiki]
Dpaul
Bureaucrats
4,713

edits

Retrieved from "http://www.idigbio.org/wiki/index.php/Special:MobileDiff/4206"

Navigation menu