https://dev.e-taxonomy.eu/redmine/https://dev.e-taxonomy.eu/redmine/redmine/favicon.ico?14691914852020-11-02T12:17:50ZEDIT Project ManagementEDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=557792020-11-02T12:17:50ZAndreas Kohlbecker
<ul><li><strong>Related to</strong> <i><a class="issue tracker-6 status-1 priority-12 priority-high14 overdue behind-schedule" href="/redmine/issues/6981">task #6981</a>: Migrate to Java 11</i> added</li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=557802020-11-02T12:19:02ZAndreas Kohlbecker
<ul><li><strong>Tags</strong> changed from <i>performance</i> to <i>performance, java</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/redmine/journals/55780/diff?detail_id=69586">diff</a>)</li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=557862020-11-02T12:36:27ZAndreas Müller
<ul></ul><p>I can't see that we have objects of size in CDM real data</p>
EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558402020-11-03T17:22:24ZAndreas Kohlbecker
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/redmine/journals/55840/diff?detail_id=69645">diff</a>)</li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558412020-11-03T17:30:22ZAndreas Kohlbecker
<ul></ul><p>I enabled G1 GC logging as described in <a href="https://plumbr.io/handbook/gc-tuning-in-practice/other-examples/humongous-allocations">https://plumbr.io/handbook/gc-tuning-in-practice/other-examples/humongous-allocations</a> the to search for humongous object allocations on the test server. A couple of minutes after rebooting, the server still is starting instances, <em>G1 Humongous Allocation</em> are being reported:</p>
<pre> 213.066: [G1Ergonomics (Concurrent Cycles) request concurrent cycle initiation, reason: requested by GC cause, GC cause: G1 Humongous Allocation]
213.067: [GC pause (G1 Humongous Allocation) (young) (initial-mark) 213.067: [G1Ergonomics (CSet Construction) start choosing CSet, _pending_cards: 31247, predicted base time: 83.62 ms, remaining time: 116.38 ms, target pause time: 200.00 ms]
220.232: [G1Ergonomics (Concurrent Cycles) request concurrent cycle initiation, reason: requested by GC cause, GC cause: G1 Humongous Allocation]
220.416: [G1Ergonomics (Concurrent Cycles) do not request concurrent cycle initiation, reason: concurrent cycle already in progress, GC cause: G1 Humongous Allocation]
374.271: [G1Ergonomics (Concurrent Cycles) request concurrent cycle initiation, reason: requested by GC cause, GC cause: G1 Humongous Allocation]
374.324: [G1Ergonomics (Concurrent Cycles) do not request concurrent cycle initiation, reason: concurrent cycle already in progress, GC cause: G1 Humongous Allocation]
385.183: [G1Ergonomics (Concurrent Cycles) request concurrent cycle initiation, reason: requested by GC cause, GC cause: G1 Humongous Allocation]
385.183: [G1Ergonomics (Concurrent Cycles) request concurrent cycle initiation, reason: requested by GC cause, GC cause: G1 Humongous Allocation]
385.183: [GC pause (G1 Humongous Allocation) (young) (initial-mark) 385.183: [G1Ergonomics (CSet Construction) start choosing CSet, _pending_cards: 40507, predicted base time: 76.38 ms, remaining time: 123.62 ms, target pause time: 200.00 ms]
392.099: [G1Ergonomics (Concurrent Cycles) request concurrent cycle initiation, reason: requested by GC cause, GC cause: G1 Humongous Allocation]
392.219: [G1Ergonomics (Concurrent Cycles) do not request concurrent cycle initiation, reason: concurrent cycle already in progress, GC cause: G1 Humongous Allocation]
</pre>
<p>so there is strong evidence that we in deed have big sized objects!</p>
EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558422020-11-03T17:30:44ZAndreas Kohlbecker
<ul><li><strong>Assignee</strong> changed from <i>Andreas Müller</i> to <i>Andreas Kohlbecker</i></li><li><strong>Target version</strong> changed from <i>Unassigned CDM tickets</i> to <i>Release 5.19</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>10</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558432020-11-03T17:30:53ZAndreas Kohlbecker
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558522020-11-04T10:29:58ZAndreas Kohlbecker
<ul><li><strong>File</strong> <a href="/redmine/attachments/1945">g1-humongous-allocations.txt</a> <a class="icon-only icon-download" title="Download" href="/redmine/attachments/download/1945/g1-humongous-allocations.txt">g1-humongous-allocations.txt</a> added</li><li><strong>% Done</strong> changed from <i>10</i> to <i>20</i></li></ul><p>further results from the test server after startup and running the Data Portal Cacher for E+M by 8,5% (<a class="attachment" href="https://dev.e-taxonomy.eu/redmine/attachments/1945">g1-humongous-allocations.txt</a>). 176 G1 Humongous Allocations have been reported.</p>
<p>These big objects may be result sets from database queries, but other cases are also possible.</p>
EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558562020-11-04T11:00:32ZAndreas Kohlbecker
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Feedback</i></li><li><strong>Assignee</strong> changed from <i>Andreas Kohlbecker</i> to <i>Andreas Müller</i></li><li><strong>% Done</strong> changed from <i>20</i> to <i>10</i></li></ul><p>this finding can be especially relevant for imports and exports, therefore we should examine I/O functionalities which have been reported to cause problems in the near past. Isn't it that Walter had Problems a couple of weeks ago? </p>
<p>Do you remember anything like this Andreas & Katja?</p>
EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=558572020-11-04T11:08:33ZKatja Luther
<ul></ul><p>Andreas Kohlbecker wrote:</p>
<blockquote>
<p>this finding can be especially relevant for imports and exports, therefore we should examine I/O functionalities which have been reported to cause problems in the near past. Isn't it that Walter had Problems a couple of weeks ago? </p>
<p>Do you remember anything like this Andreas & Katja?</p>
</blockquote>
<p>Yes the cdmlight export for larger subtrees or a whole classification can cause memory problems.</p>
EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=579652021-01-27T15:50:30ZAndreas Müller
<ul><li><strong>Target version</strong> changed from <i>Release 5.19</i> to <i>Release 5.21</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=587982021-03-02T20:41:26ZAndreas Müller
<ul><li><strong>Target version</strong> changed from <i>Release 5.21</i> to <i>Release 5.22</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=603702021-04-20T15:17:47ZAndreas Müller
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>New</i></li><li><strong>Target version</strong> changed from <i>Release 5.22</i> to <i>Release 5.46</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=617902021-07-05T17:16:33ZAndreas Müller
<ul><li><strong>Tracker</strong> changed from <i>report</i> to <i>task</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=655462022-03-23T09:59:52ZAndreas Müller
<ul><li><strong>Target version</strong> changed from <i>Release 5.46</i> to <i>Release 5.44</i></li></ul> EDIT - task #9268: Check cdm for GC G1 humongous objects problemhttps://dev.e-taxonomy.eu/redmine/issues/9268?journal_id=683642023-01-05T16:55:26ZAndreas Müller
<ul><li><strong>Tags</strong> changed from <i>performance, java</i> to <i>performance</i></li></ul>