Data Ingestion Report

From iDigBio
Revision as of 15:35, 12 February 2014 by Godfoder (talk | contribs)
Jump to navigation Jump to search

This is the progress of the ingestion of data into iDigBio's portal, a quick view of ongoing process and the results. The most updated counts on ingested datasets can be found at: http://www.idigbio.org/portal/publishers

Data Status in the various queues

In the ingesting queue:

  • OSU (~484568 specimens, Submitted: Jan/10/2014, Accepted: --/--/----)
  • CCBER / VertNet (15,637 (herps), 1,948 (mammals), 7,000 (birds) specimens. Submitted: Feb/10/2014, Accepted: Feb/12/2014)
  • CRCM / VertNet (29,458 specimens. Submitted: Feb/10/2014-, Accepted: Feb/12/2014)
  • WFVZ / VertNet (225,226 specimens. Submitted: Feb/10/2014, Accepted: Feb/12/2014)
  • TNHC / VertNet (85,519 (herps), 54,244 (fish) specimens Submitted: Feb/10/2014, Accepted: Feb/12/2014)

In the mobilizing queue:

In the negotiating queue:


In the pre-negotiating queue:

  • Joe Cook at UNM,

Note: Redmine links above require a logid
Last updated: Feb/10/2014

XML File For Providers

Data mobilizers are to fill in this XML table for all providers when submitting a dataset, unless that data are available to the cyberinfrastructure team via an IPT eml.xml file.

Additional Statistics at Various Stages of Ingestion

  • Provided = data counts of specimens and media in datasets as given by the provider
  • Ingested = data counts of specimens and media per dataset that can be found in the iDigBio API
  • Indexed = data counts of specimens and media per dataset that can be found through searching

Cells with pink or yellow show discrepancies in count as data progress in the pipeline (more or less than the previous stage respectively). Pink cases in the "Specimen Ingested" column indicate the recordsets from which the provider has deleted records, the yellow cases in the "Ingested Specimens" column indicate recordsets that can be updated in iDigBio's next harvest, and yellow cases in the "Specimens Indexed" indicate cases currently in the process of ingestion.

The full table can be also downloaded as an Excel file. The table presents numbers as of February 08, 2014.

RecordsetGUID

Source

Code

Specimens Provided

Media Provided

Specimens Ingested

Media Ingested

Specimens Indexed

Media Indexed

f83517ea-7b9f-443d-9371-d11a05ebc0a7

SCAN

UNL-SCARAB

0

0

0

0

0

0

69037495-438d-4dba-bf0f-4878073766f1

SCAN

NAUF

25695

751

24585

64

24585

64

9bd4ff72-1cb2-431f-bf7b-b5d47e08cc02

SCAN

UDAF-UDAFE

187

0

187

0

187

0

ff111763-e72d-4f24-8914-b5b2dd94908c

SCAN

NMSU-NMSU

38225

0

38250

0

38250

0

31c140bc-e6f1-4acc-beaf-b825cf288ad9

SCAN

UA-UAIC

24774

13008

24774

22864

24774

22864

5aac25d2-bcfb-4084-a700-584311ea539d

SCAN

DMNS-DMNS

41124

233

41124

233

41124

233

ab4b6a2b-a90a-44ce-95a1-2c44c911fcc6

SCAN

ASU

37444

640

37444

640

37444

640

89eb1ad0-ae60-4e8a-bf34-a53d0423bc80

SCAN

NAU-NPS

7101

6

12797

6

12797

6

6539877e-82dc-485c-ad3d-038f383d5431

SCAN

UMNH-ENT

6216

0

6216

0

6216

0

92dd8c8e-c048-4f0a-9b5d-2ee627d2f553

SCAN

CSU-CSUC

33338

9

33339

9

33339

9

7fcdca8e-7469-480c-8516-cce4e24c37c9

SCAN

UNM-MSBA

25705

0

25705

0

25705

0

d767f759-af64-4464-8614-c77ca44cad8d

SCAN

Kutztown-GPSC

51

0

51

0

51

0

82541f90-fe8e-4d66-84d8-4fe515dc5533

SCAN

UCB-UCMC

40131

0

40131

0

40131

0

a3b77120-3770-46dd-ba47-6941eff848b3

SCAN

TAMU-TAMUIC

68237

0

68237

0

68237

0

9ace4c05-d930-45c7-8d2d-0cadff1ea32b

SCAN

MCZ

9733

0

9733

0

9733

0

5e893602-84ca-4c8c-bac1-99111c777582

SCAN

TTU-TTU-Z

26093

23227

26093

23227

26093

23227

054f69cb-07c9-458e-bc91-3800c5823e70

SCAN

MCZ-temp

102707

0

134245

0

134245

0

da1ef9b1-761b-4bc3-8ac0-b9a109101f5f

OSU

osum-amphibians

4972

0

0

0

0

0

84006c59-fead-4b84-b3b5-cedf28f67ea9

OSU

ucfc

11649

0

11649

0

0

0

b5d8168e-c310-4870-aa88-eeb3c25256fd

OSU

osum-mammals

6470

0

0

0

0

0

87fee729-2a4e-4d23-ad8a-5e03e1ab7c1a

OSU

osum-fish

93515

0

0

0

0

0

fc628e53-5fdf-4436-9782-bf637d812b48

OSU

osuc

282491

0

0

0

0

0

3b9ecf1e-3c04-4d8b-84cd-9ae48e70e13a

OSU

osum-birds

25747

0

0

0

0

0

efc8b829-65b0-4fff-b6b2-f1148c68f80d

OSU

osum-reptiles

2387

0

2387

0

0

0

95773ebb-2f5f-43f0-a652-bfd8d5f4707a

OSU

osal

57337

0

57337

0

0

0

215eeaf0-0a88-409e-a75d-aec98b7c41eb

Intermountain

UTC

126416

20983

126586

20984

121210

20984

5835f642-2560-4e3e-9c25-741a12cc3fe8

Intermountain

KHD

54816

52079

49055

38176

49055

38176

b12b08da-3d05-4406-a051-0139a33ecf35

Intermountain

ENLC

2087

0

2087

0

2087

0

6bb853ab-e8ea-43b1-bd83-47318fc4c345

FLMNH

invertebratezoology

535561

0

535538

0

535538

0

48e1b8c1-91aa-4b87-8ca0-de1f81232eaf

FLMNH

mammals

32598

0

32596

0

32596

0

bd7cfd55-bf55-46fc-878d-e6e11f574ccd

FLMNH

herpetology

168379

0

168336

0

168336

0

c38b867b-05f3-4733-802e-d8d2d3324f84

FLMNH

ichthyology

217160

0

217089

0

217089

0

314f66a9-2b8f-4085-b10c-0f083ce2f1eb

LBCC-B

UWFP

0

0

0

0

0

0

b1c7a275-21f6-4b66-895d-d497359b34a1

LBCC-B

UTC

1412

8

1412

8

1412

8

e39f6dee-f2cf-4eff-afc9-4600cafe660c

LBCC-B

PH

12463

0

12463

0

12463

0

f3a5ec1a-49dd-4a52-8bd8-67cacae7a7ac

LBCC-B

FTG

0

0

0

0

0

0

fccc3c1d-d9df-4ffd-b7e1-1b9eb11f95b1

LBCC-B

FLAS

22308

23247

22308

23247

22308

23247

e881a3e2-f7ba-43c8-ae9a-11fcbfd741bb

LBCC-B

TENN

29279

25913

29279

25913

29279

25913

181352ea-3598-4f32-b919-c8f6097f4c65

LBCC-B

MSC

22242

22242

22242

22242

22242

22242

77b762ba-7cda-4617-97d7-e78df7f6dfab

LBCC-B

BING

1061

3

1061

3

1061

3

8e5fffb5-0b22-472d-8386-de291d17d513

LBCC-B

LSU

3884

2915

3884

2915

3884

2915

ce02a047-625d-4017-aeef-2c34e53824c8

LBCC-B

OS

0

0

0

0

0

0

abe3903e-ceba-4864-aa5d-bd985c70fa21

LBCC-B

CONN

430

430

430

430

430

430

c5d42fed-eed0-4e14-9625-f8a9c0ff6bb1

LBCC-B

NEBK

3827

4200

3827

4200

3827

4200

9c963109-9898-4953-a351-d5ee36d6115b

LBCC-B

WVA

0

0

0

0

0

0

b62cf6c0-e046-4c3f-9765-d0e046072b0f

LBCC-B

MAINE

0

0

0

0

0

0

bbf5f8ed-f33f-40ba-9d0d-1c24dfec4193

LBCC-B

NEB

10709

13636

10709

13636

10709

13636

41350373-fc6f-4dd9-b908-27805fff9155

LBCC-B

SRP

668

790

668

790

668

790

00d9fcc1-c8e2-4ef6-be64-9994ca6a32c3

LBCC-B

NY

358288

14308

358288

14308

358288

14308

0dd7c8dd-412c-4a13-a1d3-47e1e1af5455

LBCC-B

F

82708

32672

82708

32672

82708

32672

4830ffb8-669a-4717-bec8-2f2374f52120

LBCC-B

DUKE

197883

20127

197883

20127

197883

20127

ab820732-0844-4323-ba14-c58c24f3fc7e

LBCC-B

MICH

39953

25475

39953

25475

39953

25475

e812c193-89b5-4da8-980d-e759ac50ffba

LBCC-B

MO

250667

21834

250667

21834

250667

21834

35c43eda-1f4a-4713-bb69-e3fbe1bf792f

LBCC-B

UC

95192

1

95192

1

95192

1

f1a78c0f-449c-45fa-9472-0b92cc2a58da

LBCC-B

WTU

74141

23082

74141

23082

74141

23082

f33e9494-7b3c-4ac6-a735-59693b5a9638

LBCC-B

VT

16775

16773

17533

16773

17533

16773

8445ab25-ff89-44b0-90f8-bf0790f50afc

LBCC-B

ALA

6418

0

6418

0

6418

0

1da2a87d-4fc7-4233-b127-59cb8d1ca5ee

LBCC-B

NHA

1167

1167

1167

1167

1167

1167

e0e37702-32af-405b-b652-ee54b5bb94e2

LBCC-B

ILL

24439

29444

24439

29444

24439

29444

7809d96b-7edf-4ef7-9f12-59967e9a01a6

LBCC-B

COLO

47618

48608

47618

48608

47618

48608

5a0d649f-a64f-4e20-a37c-2fe7f9e37bad

LBCC-B

Harvard University

5145

1

5145

1

5145

1

ccba425a-25e0-4d94-8fde-3890be03ae1b

LBCC-B

EVE

304

0

304

0

304

0

f4214a7a-6793-48e0-ac41-9baff83096d3

LBCC-B

ILLS

2743

0

2743

0

2743

0

333ac26a-30bc-4e0c-a6ef-c57a40f6bd99

LBCC-B

NCU

2391

2630

2391

2630

2391

2630

cd177f63-761b-44f6-866e-ee19d2ac134e

LBCC-B

BRIT

1255

1250

1255

1250

1255

1250

6ac89a16-4604-4a78-9047-dcc57e5c0130

LBCC-B

MOR

0

0

0

0

0

0

0072bf11-a354-4998-8730-c0cb4cfc9517

LBCC-B

USF

0

0

0

0

0

0

c3a7b339-122e-4fe9-8851-371b1fdf584e

LBCC-B

FTU

0

0

0

0

0

0

62254613-2696-4834-8c58-5c465f70df56

LBCC-B

WIS

0

0

0

0

0

0

b8972f6b-c67f-45c0-b348-954866e04a0f

LBCC-B

BRY

3703

3774

3703

3774

3703

3774

2bbafa00-3162-4e8e-947c-64a13b8d3fef

LBCC-B

VSC

4069

4069

4069

4069

4069

4069

d6c6e57a-4ccb-4707-b87d-c91d01d6aa42

LBCC-B

CHRB

6833

6829

0

0

0

0

5eb57cb9-a6e8-4f84-abde-41a6bfd2080b

iDigBio

TTD_TCN_idigbio

373710

0

373710

0

373710

0

db4bb0df-8539-4617-ab5f-eb118aa3126b

iDigBio

ABS_iDigBio

5666

0

5666

0

5666

0

d70edfe9-c358-4bf3-96d2-22fddc702994

iDigBio

TTRS_Birds

3945

0

3945

0

3945

0

ef30a918-b583-41f1-9ac4-4a37591b515a

iDigBio

TTRS_Lepidoptera

1376

0

1376

0

1376

0

35ff9d4c-829f-42c9-b8ab-8dbe1a69e0d7

iDigBio

idigbio-invertnet

0

14207

0

14207

0

14207

cc75bd05-251f-4cbb-afed-100cac9d7aa0

iDigBio

INHSFish

105742

0

105742

0

105742

0

d78c4f23-f6c4-42cd-8ddf-d5a98c351545

iDigBio

TTRS_Mammals

968

0

968

0

968

0

51b958bb-9d5f-48d7-9a97-e372c0c747c3

CalAcademy

herp

308338

0

306537

0

306537

0

14a8f79f-eab7-48da-ad50-bda142703820

CalAcademy

mam

30050

0

30050

0

30046

0

ded380b5-1ba2-4089-8e0c-0aa1b4140785

CalAcademy

antweb

375851

0

375851

0

375851

0

beb74dc2-22ea-49e4-b1e3-bedb8e06e8f2

CalAcademy

ich

200203

0

200203

0

200181

0

87c45c90-ba1d-409e-a9d7-9baf5a5cbb1c

CalAcademy

ent

177466

0

177466

0

177466

0

bd61c458-b865-4b05-9f1f-735c49066e55

CalAcademy

invz

149582

0

149582

0

149582

0

26f7cbde-fbcb-4500-80a9-a99daa0ead9d

CalAcademy

botany

383217

0

383257

0

382611

0

b8cbed64-5126-46bd-97aa-43627743aba7

CalAcademy

orn

97114

0

97113

0

97113

0

7450a9e3-ef95-4f9e-8260-09b498d2c5e6

Harvard

harvard_university_herbaria

359270

0

359270

0

326464

0

40250f4d-7aa6-4fcc-ac38-2868fa4846bd

SEINET

ASU-Plants

192905

93680

192954

93820

192954

93820

b531ea59-025d-4c29-9d23-99ae75bcd55f

SEINET

ASC

78473

5

78473

5

78473

5

c569e530-7322-40b8-9b66-1e0ed96fefcb

SEINET

DES

72484

66298

72590

66410

72590

66410

271a9ce9-c6d3-4b63-a722-cb0adc48863f

MCZ

mczbase

1703112

0

1700654

0

1700654

0

95ecb448-3c1f-4145-8565-4f6d51beb62c

KU

kubi_invp

78547

0

78547

0

78547

0

f6298100-86ae-458f-9fb1-bbb3bb325422

MaCC

MIN

13557

2

13557

2

13557

0

46374ee7-7c70-48d8-bf16-2e6c1626565e

MaCC

SFSU

17808

9378

13119

4067

13119

4067

10a02814-9469-42fd-b074-22ca6c8271c7

MaCC

F

44189

0

44189

0

44189

0

3feab0ae-cfc3-40fb-b681-018c410f1996

MaCC

MICH

134336

70609

134323

70609

109314

36636

1f2b44b8-8556-4d6e-8247-4611689551cf

MaCC

FLAS

12697

12714

2352

977

2352

977

37d4d085-d8be-4826-9bc4-c6a36557fa70

MaCC

OSC

36465

0

36465

0

36465

0

7ad07cff-f782-4ddf-b780-3a757cdb77e0

MaCC

LSUM

8035

4965

8035

4967

6350

3043

645bcd10-a74f-4207-a375-0254b954b7ad

MaCC

NCU

6729

6961

6729

6961

6729

6961

02fceae6-c71c-4db9-8b2f-e235ced6624a

MaCC

UC

22027

16063

23879

16063

15997

7701

7559ca29-1d2f-4a64-993f-41939ee40947

MaCC

RET

0

0

0

0

0

0

cf641fbf-fa31-481a-993b-9204f2ee1884

MaCC

ISC

9673

6

9673

6

9673

6

91a0a18a-3196-4f87-87b6-02c7f8a12996

MaCC

NCSLG

4862

0

4696

0

4696

0

beecd160-a96c-46fc-bdce-7dcb7024d473

MaCC

WTU

44071

9094

44071

9094

44071

9094

0c15e83e-79ee-4ee3-86e3-e5f98a51dc11

MaCC

UTC

2947

3

2928

1

2928

1

04d9b721-259c-4d6b-b48f-2e23edf66c9f

MaCC

TENN

63783

7624

63369

383

63369

383

15aa4812-aad2-4b26-a1d8-d4f8d79e6163

MaCC

ARIZ

8953

0

8953

0

8953

0

fdf7bb59-aad2-4f10-879f-6c0e7d3baa64

MaCC

DBG

17126

27130

17013

26991

17013

26991

ec4289d8-1114-43b9-9f04-ad809aa1dbe3

MaCC

NY

151276

37355

146382

33647

146382

33647

e7ac8c4a-64bd-491b-b764-232de9b4bfe5

MaCC

ILLS-ILLS

46916

0

43085

0

43085

0

1eca069b-09e0-406d-9625-cb9c52e1e5cc

MaCC

DUKE

10364

2129

10006

0

10006

0

7340c0df-8829-4197-9dc7-0328b8e7f5dd

MaCC

MONTU

1415

1630

1415

3260

1415

1630

79be41bc-8142-485a-9d57-d6195f9a7c81

MaCC

CSU

1605

0

1605

0

0

0

91c5eec8-0cdc-4be2-9a99-a15ae5ec3edc

MaCC

CUP

65209

2

65209

4

65209

2

b000920c-6f7d-49d3-9d0f-2bb630d2e01a

MaCC

FH

21275

8045

21275

8045

14354

6828

b7349341-c8e2-4628-be5f-77600ba730fa

MaCC

DEWV

10582

0

10582

0

10582

0

e95396c4-1cac-4c9b-b461-5f21cd978fc6

MaCC

BPI

771095

0

771095

0

771095

0

ec248223-f277-4c02-b1fa-60056b5a689a

MaCC

VPI

5335

44

5335

44

0

0

ff0d1543-247c-4039-a8ff-cf4fc224c449

MaCC

HCOA

0

0

0

0

0

0

17cea35c-721f-4d9b-b67f-d29250064d25

LBCC-L

SBBG

33009

0

33009

0

33009

0

a6743a43-b86a-4265-9521-fad3a24461a6

LBCC-L

OMA

19034

0

19034

0

19034

0

29d217e3-754b-4a72-9e57-5cd05312e7c0

LBCC-L

NY

121422

69645

121422

69645

121422

69645

7c927849-94ed-4034-90e9-af34ac0cb47c

LBCC-L

ASU

114414

776

114473

776

114473

776

1c8ec291-8067-4b48-848b-410c2c768420

LBCC-L

USF

0

0

0

0

0

0

dfd53a42-8f63-4040-93a5-3f1347ce7686

LBCC-L

TLE

0

0

0

0

0

0

6aca6f67-a2e9-440d-a503-9501db6e6f36

LBCC-L

NEBK

198

397

198

397

198

397

821c1855-6817-40ee-8732-7f472d238513

LBCC-L

ALA

3565

0

3565

0

3565

0

ced8c9bc-e8b5-49e7-860a-289fc913860c

LBCC-L

NEB

16838

30299

16838

30299

16838

30299

ef04e127-bb7d-4bf0-82d3-767d43108f81

LBCC-L

WVA

0

0

0

0

0

0

0fcbf959-b714-4ba2-8152-0c1440e31323

LBCC-L

MAINE

0

0

0

0

0

0

4dce41dc-2af6-448c-99e1-abfd3a9cc3e5

LBCC-L

UWFP

0

0

0

0

0

0

49db9725-7bdc-4c38-8548-c32994e811c1

LBCC-L

FTU

0

0

0

0

0

0

6b565194-9707-42da-8052-9f9cf5f9aa60

LBCC-L

OS

10036

11048

10036

11048

10036

11048

fd14095c-3658-4e00-8cec-729a89459e92

LBCC-L

VT

5100

5100

5100

5100

5100

5100

0e0e9bbc-1dea-4de4-95ae-aecc90844bbf

LBCC-L

MICH

46927

43956

46928

43956

46928

43956

7110b8ba-0ead-4666-8279-e30f53e343d0

LBCC-L

PH

583

0

583

0

583

0

caaa464d-e290-4761-8550-75edc6d00119

LBCC-L

UTC

266

0

266

0

266

0

bdf65f9c-a730-4083-bd8d-a2def3037637

LBCC-L

TENN

8061

8023

8061

8023

8061

8023

1a8eea37-7c72-4032-a38a-254154449ad1

LBCC-L

MSC

105476

0

105476

0

105476

0

40987883-03cf-494a-a5cf-7c77c7aadb79

LBCC-L

LSU

29699

12728

29699

12728

29699

12728

4b92de1f-866d-4b82-af69-37d46753f289

LBCC-L

ISC

4294

0

4294

0

4294

0

b5e5c781-765f-4981-af2a-c19c250e2cf0

LBCC-L

FLAS

5014

5422

5014

5422

5014

5422

3f508496-c860-4701-93e4-84e940c8395e

LBCC-L

MIN

144182

0

144182

0

144182

0

58402fe3-37c1-4d15-9e07-0ff1c4c9fb11

LBCC-L

WIS

98927

104097

98956

104098

98956

104098

fc40fabd-0a70-48fa-b142-79990cd259a5

LBCC-L

CONN

2447

2447

2447

2447

2447

2447

99b04c9f-908e-42bd-92bc-41aa94b72949

LBCC-L

MOR

7945

15031

7945

15031

7945

15031

2eb8ff2f-4826-4fc3-be68-22d805bcae88

LBCC-L

CHRB

1734

1731

1734

1731

1734

1731

9756b9a4-c070-4359-8a07-2383b09d0d04

LBCC-L

CUP

84

0

84

0

84

0

c6e89321-fc23-4cba-ad79-be3e52edfb6d

LBCC-L

NHA

144

144

144

144

144

144

cb2e732c-20a8-4037-9ab0-67a59faeafb8

LBCC-L

KANU

14053

0

14053

0

14053

0

0bada388-4adf-4b8c-b733-0a1bfc7c233c

LBCC-L

EVE

390

0

390

0

390

0

9d2a4189-6048-46e9-bac4-e5ef566334bb

LBCC-L

MONT

8496

8858

8496

8858

8496

8858

995cc7f1-69c3-4317-ab77-28fd48f1e535

LBCC-L

COLO

0

0

0

0

0

0

c0bb93c7-5906-43be-a2af-7f61078d5d7e

LBCC-L

Harvard University

3583

218

3583

218

3583

218

d29b9265-07e6-4e73-8f72-fc42d3d83fb1

LBCC-L

DUKE

12652

13053

12658

13053

12658

13053

ef637c01-c551-4d47-8a48-4442b8ad5ecd

LBCC-L

ILL

0

0

0

0

0

0

1bb33d2d-0714-4fc9-968e-b66bab1cf3d3

LBCC-L

UC

18520

6943

18520

6943

18520

6943

9368e302-f8e7-4714-aed4-db2faa861e5c

LBCC-L

WTU

30375

3053

30375

3053

30375

3053

33fd0737-6207-42cc-bc64-cc637266b476

LBCC-L

OSC

5198

0

5198

0

5198

0

063825dc-b8c3-4962-aea4-9994bcc09bc8

LBCC-L

SRP

21618

11026

21618

11026

21618

11026

d2c71720-e156-4943-8182-0a7bbe477a37

LBCC-L

BRY

20305

20369

20305

20369

20305

20369

c481fbc6-4bd7-4c50-8537-ba1993d4eb88

LBCC-L

F

35020

0

35020

0

35020

0

df516dc6-6ef0-426d-94e3-8a2bbb0439a5

LBCC-L

NCU

4195

259

4199

294

4199

294

62f951c1-b6a8-430c-8652-5691f079152c

LBCC-L

ILLS

10453

0

10453

0

10453

0

b3f10d7b-6763-4f79-9789-f6abc68b9720

LBCC-L

FTG

0

0

0

0

0

0

   10,632,927

      1,218,931

   10,217,121

    1,179,024

      10,058,457

        1,131,870