Project

General

Profile

task #8435

Reduce logging amount of exports and other long running tasks

Added by Andreas Kohlbecker 3 months ago. Updated 3 months ago.

Status:
New
Priority:
New
Assignee:
Category:
cdmlib
Target version:
Start date:
08/01/2019
Due date:
% Done:

0%

Severity:
normal

Description

One single CDMLight export of the euromed database produces 49173 lines of logging like :

[euromed] 2019-07-31 12:04:20,009 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.87431% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,052 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.8757% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,186 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.8771% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,239 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.8785% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,298 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.87989% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,337 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88129% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,370 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88269% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:20,406 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88408% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,001 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88548% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,106 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88688% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,159 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88827% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,214 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.88967% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,274 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89107% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,306 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89246% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,346 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89386% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,379 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89526% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,427 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89665% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,467 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89805% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,520 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.89944% done (Completed Task: Writing partition 477/478)
[euromed] 2019-07-31 12:04:21,539 INFO [Thread-5721] [eu.etaxonomy.cdm.common.monitor.DefaultProgressMonitor] - 99.90084% done (Completed Task: Writing partition 477/478)

Reducing the output to report changes only at the first (or second) digit after the decimal point would reduce the amount of reported lines to 1000 (or 10000).

The DefaultProgressMonitors (also others?) should behave differently depending on the loglevel:

  • <= DEBUG: log all lines
  • >= INFO: log lines only if the number up to the first digit has changed.

Associated revisions

Revision cad668ac (diff)
Added by Katja Luther 3 months ago

ref #8431: adaptions to show the export name in progress monitor

Revision aa3118b2 (diff)
Added by Katja Luther 3 months ago

ref #8435: differ between info and debug level

History

#1 Updated by Andreas Müller 3 months ago

  • Assignee changed from Andreas Müller to Katja Luther

Katja, can you work on this?

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 40 MB)