Project

General

Profile

bug #9061

Create analyze framework for CDM Excel imports

Added by Andreas Müller about 1 month ago. Updated about 1 month ago.

Status:
New
Priority:
New
Category:
cdmadapter
Target version:
Start date:
06/10/2020
Due date:
% Done:

0%

Severity:
normal
Found in Version:
Tags:

Description

This framework should allow to analyze import data before running the import.

This should include

  • analyzeWorkbook(): ananlyzes the overall Workbook structure (obligatory worksheets with correct names, tables which are not required, ...)
  • analyzeWorksheetStructure(): which analyzes the existing columns (obligatory columns, facultative columns, columns not in use, ...)
  • analyzeData: which analyzes the data in the worksheet(s) on correctness, this includes
    • test new data: is the new data correctly formatted so it can be imported
    • test persistent data: e.g. do taxon UUIDs match with existing accepted taxa
    • ...

The framework in general should only work for csv data.

The result should be generic so it can be used for any table based imports (or even for non-table based imports).
The result should distinguish data which is generally impossible to import (e.g. a required column could not be found), data which looses certain records during import and data which has slightly incorrect import result (e.g. 1 not required field in a record can not be imported).


Related issues

Related to Edit - task #9041: Import Flora of Uzbekistan taxa altitudes Closed 05/28/2020
Related to Edit - bug #9049: Import Flora of Uzbekistan taxa habitats Closed 06/02/2020

Associated revisions

Revision 9a666f9e (diff)
Added by Andreas Müller about 1 month ago

ref #9061 a very first try to create an import analyzer framework (with example AltitudeExcelImport)

Revision 5cf1f8e1 (diff)
Added by Andreas Müller 9 days ago

ref #9061 some further steps for an import analyze framework

History

#1 Updated by Andreas Müller about 1 month ago

  • Description updated (diff)

#2 Updated by Andreas Müller about 1 month ago

  • Related to task #9041: Import Flora of Uzbekistan taxa altitudes added

#3 Updated by Andreas Müller 9 days ago

  • Related to bug #9049: Import Flora of Uzbekistan taxa habitats added

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 40 MB)