Difference between revisions of "2013 AOCR Hackathon Wiki"

From iDigBio
Jump to: navigation, search
m
 
(240 intermediate revisions by 6 users not shown)
Line 1: Line 1:
Note: This wiki page undergoing frequent updates. Those participating in the first iDigBio AOCR Hackathon need an iDigBio account. Some participants have wiki edit permissions and will add to / update / edit these pages before, during and after the hackathon.
+
{| class="wikitable" style="float:right;"
 +
! colspan="2" style="background:#D58B28;width:200px;font-size:10pt" | Digitizing the Past and Present for the Future
 +
|-
 +
| colspan="2" style="text-align:center;font-size:7pt" | [[Image:IDigBio Logo RGB.png|center|300px|iDigBio Logo RGB.png]]<br />
 +
|-
 +
!colspan="2" style="background:#D58B28;text-align:center;font-size:9pt" | Quick Links for iDigBio AOCR Hackathon Workshop
 +
|-
 +
|[https://docs.google.com/document/d/1dNbEOdL1stn-ztKDWTzfL1T4VPzg20ZZ76zV5ueFrnY/edit# iDigBio AOCR Hackathon Workshop Agenda]
 +
|-
 +
|[https://www.idigbio.org/biblio?f%5bkeyword%5d=458 iDigBio AOCR Hackathon Workshop Biblio Entries]
 +
|-
 +
|[https://www.idigbio.org/content/update-idigbio-augmenting-ocr-working-group iDigBio AOCR Hackathon Workshop Report]
 +
|}
  
Hackathon Participants
+
[[Category:Workshop]]
<ul>
+
= Welcome to the 2013 iDigBio AOCR Hackathon Wiki =
 +
*Short URL to this hackathon wiki http://tinyurl.com/aocrhackathonwiki
 +
*Those participating in the first iDigBio AOCR Hackathon need an iDigBio account.
 +
*Note: This wiki page undergoing frequent updates and some participants have wiki edit permissions and will add to / update / edit these pages before, during and after the hackathon.
 +
*[[Augmenting_OCR| AOCR Working Group Wiki]]
 +
*[[IDigBio_Augmenting_OCR_Workshop#Workshop_Presentations| AOCR October 2012 Working Group Meeting Presentations]]
 +
*[[iConference 2013 iDigBio AOCR WG Wiki]]
  
<li>Robert Anglin, ranglin@wisc.edu, Arizona State University, Symbiota Developer, LBCC TCN</li>
+
=== [https://www.dropbox.com/s/p8zjm0ajaj838tw/HackathonIconfAgendaFinal.docx Day-By-Day Schedule] ===
<li>Scott Bates, scott.thomas.bates@gmail.com, University of Colorado Boulder, MaCC TCN</li>
+
*download to have active hyperlinks
<li>Jason Best, jbest@brit.org, Botanical Research Institute of Texas</li>
+
* [https://docs.google.com/document/d/1dNbEOdL1stn-ztKDWTzfL1T4VPzg20ZZ76zV5ueFrnY/edit# Day-By-Day Online in GoogleDoc Format]
<li>Ben Brumfield, benwbrum@gmail.com, From The Page Digitization Consulting</li>
+
**NOTE: editable by participants.
<li>Stephen Chong, stevenchong@email.arizona.edu, University of Arizona, SIRLS Graduate Student</li>
+
<li>Christopher Dell, cdell@ufl.edu, University of Florida Museum of Natural History Informatics Lab</li>
+
<li>Dmitry Dmtriev, dmitriev@inhs.uiuc.edu, Illinois Natural History Survey, TTD-TCN, InvertNeet</li>
+
<li>Ryan Farrell, farrell@eecs.berkeley.edu, UC Berkeley, ICSI</li>
+
<li>Michael Giddens, mikegiddens@silverbiology.com, Silver Biology</li>
+
<li>Edward Gilbert, egbiodiversity@gmail.com, Arizona State University, Symbiota ead Developer, LBCC TCN, SCAN TCN</li>
+
<li>Stephen Gottschalk, sgottschalk@nybg.org, New York Botanical Garden</li>
+
<li>Bryan Heidorn, heidorn@email.arizona.edu, University of Arizona, School of Information Resources and Library Science (SIRLS)</li>
+
<li>Daryl Lafferty, daryl@daryllafferty.com, Arizona State University, SALIX Developer</li>
+
<li>Kevin Love, klove@flmnh.ufl.edu, University of Florida, iDigBio IT</li>
+
<li></li>
+
<li>Tianli Mo, tianli@hawaii.edu, University of Hawaii,Joseph F. Rock Herbarium</li>
+
<li>Dmitry Mozzherin, dmozzherin@mbl.edu, Marine Biological Laboratory, Encyclopedia of Live, Global Names Architecture</li>
+
<li></li>
+
<li></li>
+
<li></li>
+
<li></li>
+
</ul>
+
  
{|class="prettytable" border="1" cellpadding="2" style="float: right; margin: 0 0 1em 1em; width: 30%; border-collapse: collapse; font-size: 90%; clear: right;" | Tramontane |}
+
=== Group Notes ===
 +
*Please use [http://tinyurl.com/AOCRhackNotes AOCRhackNotes] to Capture your ideas, insights collaboratively at our hackathon.
 +
**We are excited to use this process and have found it extremely useful for collaborating effectively!
  
{| {{prettytable}}
+
== Meetings ==
|+Hackathon Participants
+
*11 Jan 2013 via AdobeConnect, 2 - 3 PM EST
|-
+
**Notes at Google Doc: http://tinyurl.com/aocrhackmeet1
! Participant !! email !! affiliation !! position !! key skills
+
*17 Jan 2013 via AdobeConnect, 2 - 3 PM EST
|-
+
**Notes at Google Doc: http://tinyurl.com/aocrhackmeet1
|Robert Anglin || ranglin@wisc.edu || Arizona State University || Symbiota Developer / LBCC TCN  || programmer
+
*25 Jan 2013 via AdobeConnect, 2 - 3 PM EST
|
+
**Notes at Google Doc: http://tinyurl.com/aocrhackmeet1
 +
*1 Feb 2013 via AdobeConnect, 2 - 3 PM EST
 +
**Notes at Google Doc: http://tinyurl.com/aocrhackmeet1
 +
*8 Feb 2013 via AdobeConnect, 3 - 4 PM EST
 +
**Notes at Google Doc: http://tinyurl.com/aocrhackmeet1
  
|-
+
== [[Presentations & Reports]] ==
|}
+
*[[Presentations & Reports#Deborah_Paul|Deborah Paul: 1st iDigBio - BRIT Hackathon]]
 +
*Alex Thompson
 +
*Daryl Lafferty
 +
*Ben Brumfield
 +
*Phuc Nguyen
 +
*[[Presentations & Reports#Robert_Anglin|Robert Anglin: Regular Expression-Based Parsing of Tesseract Output from Lichen Herbarium Labels]]
 +
*Bryan Heidorn & Qianjin Zhang
 +
*Dmitry Mozzherin
 +
*[[Presentations & Reports#Paul_Schroder|Paul & Robin Schroeder: iDigBio Hackathon: iDigBio OCR Hackathon Initial Results - Rest API]]
 +
*John Pickering
 +
*Jason Best
 +
 
 +
==Photos==
 +
*[https://www.facebook.com/media/set/?set=a.513738458670105.110787.215120891865198&type=3 Hackathon Facebook Photo Album]
 +
 
 +
== Links to Logistics, Communication, and Participant Information ==
 +
*[[2013 Hackathon Participants| Participant List]]
 +
*See [http://tinyurl.com/aocrHackerPhotos Participant Photos!] and small bio bits.
 +
**Editable by you!
 +
*[[Participant Related Projects]]
 +
**[[Participant Related Projects#EoL | EoL]]
 +
**[[Participant Related Projects#GNA | GNA]]
 +
**[[Participant Related Projects#ICSI | ICSI]]
 +
**[[Participant Related Projects#MaCC | MaCC]]
 +
**[[Participant Related Projects#Tolkin | Tolkin]]
 +
**[[Participant Related Projects#SALIX | SALIX]]
 +
**[[Participant Related Projects#LABELX | LABELX]]
 +
**[[Participant Related Projects#Symbiota | Symbiota]]
 +
**[[Participant Related Projects#ScioQualis | ScioQualis]]
 +
**[[Participant Related Projects#BiSciCol | BiSciCol]]
 +
**[[Participant Related Projects#LBCC_TCN | LBCC TCN]]
 +
**[[Participant Related Projects#Discover Life | Discover Life]]
 +
**[[Participant Related Projects#From The Page | From The Page]]
 +
**[[Participant Related Projects#DarwinCore Parser | DarwinCore Parser]]
 +
**[[Participant Related Projects#Apiary Project | The Apiary Project]]
 +
**[[Participant Related Projects#USCD Computer Vision | USCD Computer Vision]]
 +
**[[Participant Related Projects#Biodiversity Heritage Library | Biodiversity Heritage Library]]
 +
*[http://tinyurl.com/aocrHack  Call for Participation]
 +
*[http://tinyurl.com/idigbioAOCRHackathon  Application Form]
 +
*[[2013 Hackathon Logistics| Travel, Food, Lodging, Connectivity Logistics]]
 +
*2013 Hackathon Listserv, a mailing list for Hackathon Participants at aocr-hackathon-l@lists.ufl.edu
 +
 
 +
=== Remote Participation ===
 +
*[http://idigbio.adobeconnect.com/augmentocr Remote Participation via AdobeConnect]
 +
**Join us on Wednesday morning 9 AM - Noon CST to hear our hackathon participants report back to the group and share their progress on parsing algorithms.
 +
**Please sign in 15 - 20 minutes early to learn how Adobe Connect works.
 +
**[[Web Conferencing#Audio_Troubleshooting|Help with AdobeConnect]]
 +
**Want to try your skills at parsing? Share your User Interface ideas? Got mad skills for developing image-analysis and image segmentation algorithms? Know where the great authority files (data dictionaries) are? Do tell, via remote participation or in our online group notes doc.
 +
 
 +
== Overview of the Challenge ==
 +
*2013 iDigBio AOCR [[Hackathon Challenge]]
 +
**overall description of [[Hackathon Challenge#the_challenge| The Challenge]]
 +
**[[Hackathon Challenge#the_specific_task| The Specific Task]]: parse OCR output to find values for these [[2013 hackathon data elements]]
 +
**[[Hackathon Challenge#metrics_and_evaluation| Metrics and Evaluation]] to be used
 +
**[[Hackathon Challenge#three_data_sets| Three Data Sets]]
 +
***There are three data sets, that is, three different sets of images of museum specimen labels. Participants, working alone or in groups, may work on one or more data sets as they choose. The sets have been ranked, easy, medium, hard, as an estimate of how difficult it might be to successfully get good parsed data from the OCR output from each data set.
 +
**[[Hackathon Challenge#accessing_the_data| Accessing the Data]]
 +
 
 +
== Frequently Asked Questions ==
 +
*[[Hackathon FAQ]]
 +
 
 +
== Deliverables & Outputs ==
 +
*report on progress beyond parsing, accomplishments, and in-the-works
 +
*summary report on progress, including metrics evaluation
 +
*Development of [[OCR SaaS]] for use by the entire community.
 +
*code from participants (at github)
 +
*all participant's talks posted to the hackathon wiki, including links to their code, comments.
 +
*Participants talks and summary reports added to the iDigBio Biblio.
 +
*collected conversation / feedback from whole group (report back summary)
 +
*Social Media
 +
**photographs
 +
**post to Facebook
 +
**blog post to iDigBio
 +
*white paper on the hackathon process.
 +
*[[Media:HackathonGeneralWorkflowGraphic.pdf|Hackathon Workflow v1 by Robin Schroeder]]
 +
*[[REST API Documentation by Paul Schroeder]]
 +
*[http://manuscripttranscription.blogspot.com/2013/02/improving-ocr-inputs-from-ocr-outputs.html Improving OCR Inputs from OCR Outputs?] by Ben W. Brumfield. "This is a transcript of my talk at the iDigBio Augmenting OCR Hackathon, presenting preliminary results of my efforts before the event."
 +
*[http://manuscripttranscription.blogspot.com/2013/02/idigbio-augmenting-ocr-hackathon.html iDigBio Augmenting OCR Hackathon] blog post by participant Ben W. Brumfield (FromThePage.com).
 +
*[http://manuscripttranscription.blogspot.com/2013_02_01_archive.html Results of the "Ocrocrop" Approach to Improving OCR] report by participant Ben W. Brumfield (FromThePage.com).
 +
 
 +
== Choosing Images and Parsing Decisions ==
 +
*[[Image Selection and Processing Protocols]]
 +
*[[Text Transcription Issues]]
 +
 
 +
== Issues that need work ==
 +
*[http://tinyurl.com/OCRHackathonWishList Our AOCR wg Wish List]
 +
*[[Known OCR, ML, NLP Issues]] and challenges
 +
*Human-in-the-loop: [[User Interface Wish List]]
 +
*Development of integrated web services that return OCR output to providers. See the A[[OCR_SaaS]]
 +
 
 +
<pre>*Thank you NESCent, Hilmar Lapp and the HIP working group for this model.</pre>
 +
----
 +
[[Augmenting OCR|Back to the aOCR Wiki]]

Latest revision as of 15:32, 9 July 2015

Digitizing the Past and Present for the Future
iDigBio Logo RGB.png

Quick Links for iDigBio AOCR Hackathon Workshop
iDigBio AOCR Hackathon Workshop Agenda
iDigBio AOCR Hackathon Workshop Biblio Entries
iDigBio AOCR Hackathon Workshop Report

Welcome to the 2013 iDigBio AOCR Hackathon Wiki

Day-By-Day Schedule

Group Notes

  • Please use AOCRhackNotes to Capture your ideas, insights collaboratively at our hackathon.
    • We are excited to use this process and have found it extremely useful for collaborating effectively!

Meetings

Presentations & Reports

Photos

Links to Logistics, Communication, and Participant Information

Remote Participation

  • Remote Participation via AdobeConnect
    • Join us on Wednesday morning 9 AM - Noon CST to hear our hackathon participants report back to the group and share their progress on parsing algorithms.
    • Please sign in 15 - 20 minutes early to learn how Adobe Connect works.
    • Help with AdobeConnect
    • Want to try your skills at parsing? Share your User Interface ideas? Got mad skills for developing image-analysis and image segmentation algorithms? Know where the great authority files (data dictionaries) are? Do tell, via remote participation or in our online group notes doc.

Overview of the Challenge

Frequently Asked Questions

Deliverables & Outputs

Choosing Images and Parsing Decisions

Issues that need work

*Thank you NESCent, Hilmar Lapp and the HIP working group for this model.

Back to the aOCR Wiki