Data Ingestion Guidance: Difference between revisions

Jump to navigation Jump to search
Undo revision 31235 by Catchapman (talk)
(Undo revision 31235 by Catchapman (talk))
Line 360: Line 360:
Once the evaluation is successful, the ingestion process moves from '''mobilizing''' to '''ingesting''', and the data are submitted to the ingestion scripts by the cyberinfrastructure staff. If an error condition occurs, the staff evaluate whether it is a script error or a data error. If it is the latter, the staff sends an email to the mobilizing staff who may contact the provider for changes. When the errors have been addressed, the '''mobilizing''' staff re-submit the data to the '''ingesting''' staff.
Once the evaluation is successful, the ingestion process moves from '''mobilizing''' to '''ingesting''', and the data are submitted to the ingestion scripts by the cyberinfrastructure staff. If an error condition occurs, the staff evaluate whether it is a script error or a data error. If it is the latter, the staff sends an email to the mobilizing staff who may contact the provider for changes. When the errors have been addressed, the '''mobilizing''' staff re-submit the data to the '''ingesting''' staff.
==iDigBio IPT hosting==
==iDigBio IPT hosting==
If you are unable to host your own IPT, you may contact us to discuss options. We have a GBIF registered IPT resource here: http://ipt.idigbio.org
If you would like iDigBio to host your datasets, we have a GBIF registered resource here: http://ipt.idigbio.org


If this option is found to be appropriate for your data, we can also assist you in getting GBIF USGS endorsement for your data in our IPT (applicable to US-based datasets only).
We can also assist you in getting GBIF USGS endorsement for your data in our IPT (applicable to US-based datasets only).


Please [https://www.idigbio.org/contact/Caitlin_%E2%80%9CCat%E2%80%9D_Chapman contact us] if you are interested in this option for hosting your data.
When sending us CSV updates to your dataset hosted in this IPT, please send the whole dataset again, not only the updates. We do a replace records operation between the current data and the new data, rather than an append. Be mindful that if you re adding fields to your export, to put them at the end of the columns in your CSV, because IPT is not set up to look for your mapped fields in a different order than the original.
 
<!-- When sending us CSV updates to your dataset hosted in this IPT, please send the whole dataset again, not only the updates. We do a replace records operation between the current data and the new data, rather than an append. Be mindful that if you re adding fields to your export, to put them at the end of the columns in your CSV, because IPT is not set up to look for your mapped fields in a different order than the original. --!>


== Sample scenarios of data transformations to prepare data for ingestion  ==
== Sample scenarios of data transformations to prepare data for ingestion  ==
267

edits

Navigation menu