bug #9061
Create analyze framework for CDM Excel imports
Start date:
06/10/2020
Due date:
% Done:
0%
Severity:
normal
Found in Version:
Description
This framework should allow to analyze import data before running the import.
This should include
- analyzeWorkbook(): ananlyzes the overall Workbook structure (obligatory worksheets with correct names, tables which are not required, ...)
- analyzeWorksheetStructure(): which analyzes the existing columns (obligatory columns, facultative columns, columns not in use, ...)
- analyzeData: which analyzes the data in the worksheet(s) on correctness, this includes
- test new data: is the new data correctly formatted so it can be imported
- test persistent data: e.g. do taxon UUIDs match with existing accepted taxa
- ...
- test new data: is the new data correctly formatted so it can be imported
The framework in general should only work for csv data.
The result should be generic so it can be used for any table based imports (or even for non-table based imports).
The result should distinguish data which is generally impossible to import (e.g. a required column could not be found), data which looses certain records during import and data which has slightly incorrect import result (e.g. 1 not required field in a record can not be imported).
Related issues
Associated revisions
ref #9061 a very first try to create an import analyzer framework (with example AltitudeExcelImport)
ref #9061 some further steps for an import analyze framework
History
#1 Updated by Andreas Müller 7 months ago
- Description updated (diff)
#2 Updated by Andreas Müller 7 months ago
- Related to task #9041: Import Flora of Uzbekistan taxa altitudes added
#3 Updated by Andreas Müller 7 months ago
- Related to bug #9049: Import Flora of Uzbekistan taxa habitats added
#4 Updated by Andreas Müller about 2 months ago
- Target version changed from Release 5.18 to Release 5.19