Project

General

Profile

bug #6627

Remaining cdm light issues

Added by Katja Luther almost 2 years ago. Updated 4 days ago.

Status:
New
Priority:
Highest
Assignee:
Category:
cdmadapter
Target version:
Start date:
05/08/2017
Due date:
% Done:

10%

Severity:
normal
Found in Version:

Description

  • Instance name and instance ID

  • TitlePageYear (in 5.0)

  • support for misapplied names (in 5.0)

  • fix handling of synonym secundum (in 5.0)

  • Collation: Wird nicht ausgegeben. Konkateniert aber auch nur die zwei folgenden (Vol/Issue, Detail) mit Doppelpunkt und Leerzeichen dazwischen (Note AM: nein da kommen im generischen Fall noch mehr Felder dazu, z.B. series)

  • eigene Tabelle für Identifier

  • Facts containing only media data should be moved to an extra table.

  • Discuss whether we should handle the citation facts separate to the other simple facts because it is confusing that the row in the simple fact table is no information.

  • add export of usage data

  • add export of annotations

  • add export of name facts

  • add export of IndividualsAssociations and TaxonInteractions

Open "bugs" from WGB:

  • User friendly result
  • Sonderzeichen
  • Collation leer (s.o.)
  • Problem bei CommonNames, es wird nicht iteriert sondern immer der gleiche angezeigt
  • ScientificName.AbbreviatedTitle für Book ist leer
  • Taxon_FK missing in SpecimenFact

Related issues

Related to Edit - feature request #6752: Add verbatimDate Closed
Related to Edit - task #6754: Adapt DwcA Export to CDM light export strategy Closed 06/26/2017
Related to Edit - bug #6968: Unexpected error in CDM light when exporting Individuals Association with no unit attached Closed 09/21/2017
Related to Edit - feature request #7334: Make pro parte and partial synonyms real concept relationships Resolved 03/28/2018
Related to Edit - feature request #8175: add name facts to cdm light export Resolved 03/12/2019
Blocked by Edit - feature request #6516: Add instance name and instance ID to CDM meta data In Progress 03/15/2017
Copied from Edit - feature request #6314: CDM light (csv) export implemented Closed 03/23/2017

Associated revisions

Revision cbcb3b1b (diff)
Added by Katja Luther almost 2 years ago

changes for outputmodel: encoding, shortCitation

Revision 18d660e0 (diff)
Added by Katja Luther almost 2 years ago

fix specimen fact export

Revision 70e986c5 (diff)
Added by Katja Luther almost 2 years ago

outputmodel reference title for books

Revision 38181dd6 (diff)
Added by Andreas Müller almost 2 years ago

ref #6627 fix Taxon_FK Problem in OutputModelClassificationExport for SimpleSpecimen

Revision b8a2a1ad (diff)
Added by Andreas Müller almost 2 years ago

ref #6627 add error handling to CDM light export

Revision fed12afd (diff)
Added by Andreas Müller almost 2 years ago

ref #6627 add error handling to CDM light export (II)

Revision 7c83c6af (diff)
Added by Katja Luther almost 2 years ago

csv light export: smaller changes in specimen.locality and reference.shortCitation

Revision a67200bf (diff)
Added by Katja Luther almost 2 years ago

csv light export: smaller changes in scientificName: year published and volume for booksections

Revision e75532a6 (diff)
Added by Katja Luther almost 2 years ago

smaller changes in wizard for file export

Revision f6b1d0ad (diff)
Added by Katja Luther almost 2 years ago

rename outputmodel -> cdmLight

Revision 3510f376 (diff)
Added by Katja Luther almost 2 years ago

outputmodel -> cdmLight

Revision c7794cca (diff)
Added by Katja Luther almost 2 years ago

cdmLight export configurator: configure whether result is a zip file or not

Revision 0b4f079d (diff)
Added by Katja Luther almost 2 years ago

cdmLight Export create zip is configurable and save last export folder

Revision 75f480ed (diff)
Added by Katja Luther almost 2 years ago

reorganize publication date output in cdm light export

Revision d07c4f93 (diff)
Added by Andreas Müller over 1 year ago

ref #6627 adapt error handling for cdm ligth export

Revision f0a54536 (diff)
Added by Andreas Müller over 1 year ago

ref #6627 adapt handling of state in OutputModelResultProcessor

Revision 4f831acf (diff)
Added by Andreas Müller over 1 year ago

ref #6627 adapt handling of state in OutputModelResultProcessor

Revision 68ce58c8 (diff)
Added by Andreas Müller over 1 year ago

ref #6627 Adapt OutputModelExportActivator to new name

Revision 68a2b5ca (diff)
Added by Andreas Müller over 1 year ago

ref #6627 improve export result handling for cdm light

Revision cfe7511f (diff)
Added by Katja Luther over 1 year ago

ref #6627: avoid NPE when children list contains null values

Revision 430901e7 (diff)
Added by Katja Luther over 1 year ago

ref #6627: avoid NPE when children list contains null values

Revision e5c27931 (diff)
Added by Katja Luther over 1 year ago

ref #6627: facts containing only media exported to an media table

Revision 86244fd8 (diff)
Added by Katja Luther over 1 year ago

ref #6627: use taxonnodeFilter and partitioner for cdmLightExport

Revision 417a8287 (diff)
Added by Katja Luther over 1 year ago

move initialize to constructor and small changes in cdmlightexport

Revision 2985a328 (diff)
Added by Katja Luther about 1 year ago

add proparte synonym information to csv light export

Revision b436f19a (diff)
Added by Andreas Müller 10 months ago

ref #7334, ref #6627 Adapted CDM light to support pp synonyms (cont.)

Revision 46d5e141 (diff)
Added by Andreas Müller 10 months ago

ref #6752, ref #6627 fill verbatimDate in CDM light

Revision 1e610f38 (diff)
Added by Katja Luther 4 days ago

ref #6627: add import of taxon interactions to cdmlight

Revision 1b2d19db (diff)
Added by Katja Luther 4 days ago

ref #6627: add import of taxon interactions to cdmlight - continue

History

#1 Updated by Katja Luther almost 2 years ago

#2 Updated by Andreas Müller almost 2 years ago

#3 Updated by Andreas Müller almost 2 years ago

#4 Updated by Andreas Müller almost 2 years ago

  • Description updated (diff)

#5 Updated by Andreas Müller almost 2 years ago

#6 Updated by Andreas Müller almost 2 years ago

  • Description updated (diff)

#7 Updated by Andreas Müller almost 2 years ago

  • Description updated (diff)

#8 Updated by Katja Luther almost 2 years ago

Katja Luther wrote:

  • Instance name and instance ID

  • TitlePageYear

  • Collation: Wird nicht ausgegeben. Konkateniert aber auch nur die zwei folgenden (Vol/Issue, Detail) mit Doppelpunkt und Leerzeichen dazwischen (Note AM: nein da kommen im generischen Fall noch mehr Felder dazu, z.B. series)

  • eigene Tabelle für Identifier

  • Facts containing only media data should be moved to an extra table.

  • Discuss whether we should handle the citation facts separate to the other simple facts because it is confusing that the row in the simple fact table is no information.

  • add export of usage data

  • add export of annotations

  • add export of IndividualsAssociations and TaxonInteractions

Open "bugs" from WGB:

  • User friendly result
  • Sonderzeichen
  • Collation leer (s.o.)
  • Problem bei CommonNames, es wird nicht iteriert sondern immer der gleiche angezeigt
  • ScientificName.AbbreviatedTitle für Book ist leer

#9 Updated by Andreas Müller almost 2 years ago

  • Description updated (diff)

#10 Updated by Katja Luther almost 2 years ago

Hallo,

wir haben Zitate, die z.B. folgendermaßen aussehen:
Mauria heterophylla Kunth, Nov. Gen. Sp. 7: 13-14, t. 606. "1825" [1824].
Das ist aus der Salvador Datenbank
Basellaceae Raf., Fl. Tellur. 3: 44. "1836" [1837]. nom. cons.
aus Caryophyllales_spp

Das bedeutet, dass das gedruckte Datum (in Anführungsstrichen, meist auf der Titelseite) falsch ist, und die Publikation wirklich erst im in eckigen Klammern angegebenen Jahr erfolgte. (Es gibt auch noch andere Schreibweisen, dies scheint mir aber die eindeutigste von den Kurzformen zu sein; IPNI macht’s neuerdings ganz ausführlich:

Leuenbergeria Lodé -- Cact.-Avent. Int. 97: 26. 2012 [dt. Jan 2013; issued 28 Dec 2012] ).

Im CDM habe wir keine atomisierte Angabe des TitlePageYears (also der Angabe in Anführungszeichen), die man aber besser in „VerbatimDate“ oder „VerbatimPublicationDate“ umtaufen sollte.

Im Editor wird das korrekte Publikationsjahr (hier 1889) für das atomisierte Date genommen, ein Feld für das auf der Titelseite (fälschlich) angegebene gibt es noch nicht, daher schreiben wir den ganzen string in der von uns gewünschten Formatierung in das Freetext Feld, das dann, wenn vorhanden, bevorzugt in die Ausgabe genommen wird:

Im Export haben wir nun drei Spalten, DatePublished, YearPublished und TitlePageYear und Du hast recht, das geht noch ein bisschen durcheinander. Bisher scheint es so zu sein:
Bei PublicationDate kommt der Freetext heraus, wenn vorhanden, sonst das atomisierte Jahr.
Bei PublicationYear kommt das atomisierte Jahr (ggf. als Range)
Bei TitlePageYear garnichts.
In meiner Ausgabe habe ich daher immer das PublicationDate benutzt.

Ich schlage vor, das gleich langfristig in Ordnung zu bringen:
PublicationDate: Der Start/End Date Range.
PublicationYear: Nur das Jahr aus dem Start/End Date Range

@Andreas – ist eine Angabe des „VerbatimDate“ im Modell angedacht? Wenn ja, sollten wir das TitlePageYear in VerbatimYear umbenennen und in der Ausgabe lassen, zwecks späterer Nutzung, jetzt aber leer.

Wenn nicht, sollten wir das TitlePageYear rauslassen und statt dessen eine Spalte „OutputDate“ einfügen, in der dann das steht, was bisher in das PublicationDate geschrieben wurde, also Freetext und wenn dieser leer das PublicationDate (range).

Wenn Du das so einrichtest, sag‘ mir bitte Bescheid, wie bei jeder Strukturänderung muss ich das dann in meinen Ausgaben entsprechend ändern.

Herzlichen Gruß
Walter

#11 Updated by Andreas Müller almost 2 years ago

#12 Updated by Andreas Müller over 1 year ago

  • Related to task #6754: Adapt DwcA Export to CDM light export strategy added

#13 Updated by Andreas Müller over 1 year ago

  • Subject changed from Remaining output model issues to Remaining cdm light issues

#14 Updated by Katja Luther over 1 year ago

  • Target version changed from Release 4.8 to Release 4.10

#15 Updated by Andreas Müller over 1 year ago

  • Related to bug #6968: Unexpected error in CDM light when exporting Individuals Association with no unit attached added

#16 Updated by Andreas Müller over 1 year ago

  • Target version changed from Release 4.10 to Release 4.11

#17 Updated by Andreas Müller over 1 year ago

  • Target version changed from Release 4.11 to Release 4.12

#18 Updated by Andreas Müller over 1 year ago

  • Target version changed from Release 4.12 to Release 4.13

#19 Updated by Katja Luther about 1 year ago

the isProParte flag is added to the synonym table

#20 Updated by Andreas Müller about 1 year ago

  • Target version changed from Release 4.13 to Release 4.14

#21 Updated by Andreas Müller about 1 year ago

  • Target version changed from Release 4.14 to Release 5.0

#22 Updated by Andreas Müller 10 months ago

#23 Updated by Andreas Müller 10 months ago

  • Target version changed from Release 5.0 to Release 5.1

#24 Updated by Andreas Müller 10 months ago

  • Description updated (diff)
  • % Done changed from 0 to 10

#25 Updated by Andreas Müller 10 months ago

  • Description updated (diff)

#26 Updated by Andreas Müller 9 months ago

  • Target version changed from Release 5.1 to Release 5.2

#27 Updated by Andreas Müller 7 months ago

  • Target version changed from Release 5.2 to Release 5.3

#28 Updated by Katja Luther 7 months ago

  • Target version changed from Release 5.3 to Release 5.4

#29 Updated by Andreas Müller 5 months ago

  • Target version changed from Release 5.4 to Release 5.5

#30 Updated by Katja Luther about 2 months ago

  • Description updated (diff)
  • Target version changed from Release 5.5 to Release 5.6

#31 Updated by Andreas Müller about 1 month ago

  • Target version changed from Release 5.6 to Reviewed Next Major Release

#32 Updated by Katja Luther about 1 month ago

  • Target version changed from Reviewed Next Major Release to Release 5.6

the name facts should be implemented in 5.6

#33 Updated by Andreas Müller about 1 month ago

Can you add the name facts to the TODO list? Is there an explicit ticket?

#34 Updated by Katja Luther 13 days ago

  • Description updated (diff)

#35 Updated by Katja Luther 13 days ago

#36 Updated by Katja Luther 13 days ago

the name facts are implemented now, see #8175

#37 Updated by Katja Luther 4 days ago

  • Description updated (diff)

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 40 MB)