Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "EclipseLink/Development/Performance"

(Performance)
 
(19 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=Performance=
 
 
 
This is the main development page for EclipseLink performance.
 
This is the main development page for EclipseLink performance.
  
EclipseLink performance is tracked through several mechanism.
+
EclipseLink performance is tracked through several mechanisms.
* Weekly regression performance unit tests.
+
* Milestone third party product performance unit tests comparisons.
+
 
* Milestone concurrency regression unit tests.
 
* Milestone concurrency regression unit tests.
 
* Milestone performance regression unit tests.
 
* Milestone performance regression unit tests.
Line 18: Line 14:
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 +
<tr><td>JPA</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 +
<tr><td>JPA</td><td>OpenJPAJPAPerformanceRegressionModel</td><td>Compares EclipseLink with OpenJPA.</td></tr>
 
<tr><td>JPA</td><td>EssentialsJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink Essentials.</td></tr>
 
<tr><td>JPA</td><td>EssentialsJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink Essentials.</td></tr>
 
<tr><td>JPA</td><td>TopLinkJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink.</td></tr>
 
<tr><td>JPA</td><td>TopLinkJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink.</td></tr>
 
<tr><td>JPA</td><td>JPAMemoryLeakModel</td><td>Tests for possible memory leaks in EclipseLink.</td></tr>
 
<tr><td>JPA</td><td>JPAMemoryLeakModel</td><td>Tests for possible memory leaks in EclipseLink.</td></tr>
</table>
 
 
====Results====
 
* [http://stame02.us.oracle.com/eclipselink/ Weekly Performance Test Results (on Oracle)]
 
 
 
<table border=1 cellspacing=0 cellpadding=2>
 
<tr style="background:#ffdead">
 
<td>Date last run</td> <td>Test</td> <td>Build</td> <td>Baseline</td> <td>Machine</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Pass</td> <td>Error</td> <td>Fail</td> <td>Warning</td> <td>Total</td> <td>Success</td>
 
</tr>
 
 
<tr>
 
<td>2008-07-11</td> <td>PerformanceTestModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-07-11</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>41</td> <td>0</td> <td>0</td> <td>0</td> <td>41</td> <td>Passed</td>
 
</tr>
 
<tr>
 
<td>2008-07-11</td> <td>JPAMemoryLeakModel</td> <td>1.0:20080711</td> <td></td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>4</td> <td>0</td> <td>0</td> <td>0</td> <td>4</td> <td>Passed</td>
 
</tr>
 
 
 
<tr>
 
<td>2008-05-10</td> <td>PerformanceTestModel</td> <td>1.0:20080509</td> <td>1.0:20080502</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>61</td> <td>1</td> <td>0</td> <td>0</td> <td>62</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-05-10</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080509</td> <td>1.0:20080502</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>38</td> <td>5</td> <td>2</td> <td>0</td> <td>45</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-03-18</td> <td>ConcurrencyComparisonTestModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>13</td> <td>1</td> <td>0</td> <td>0</td> <td>14</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-03-06</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>45</td> <td>0</td> <td>0</td> <td>0</td> <td>45</td> <td>Passed</td>
 
</tr>
 
<tr>
 
<td>2008-03-02</td> <td>PerformanceTestModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR1</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Passed</td>
 
</tr>
 
 
</table>
 
</table>
  
 
===Links===
 
===Links===
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Technology&product=EPS%28EclipseLink%29&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
+
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
 +
* [[EclipseLink/DesignDocs/221546(2.0)|EclipseLink 2.0 Performance project]]
 +
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=RT&component=Foundation&component=JPA&product=EclipseLink&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
  
 
[[Category:EclipseLink|Performance]]
 
[[Category:EclipseLink|Performance]]

Latest revision as of 09:23, 23 July 2014

This is the main development page for EclipseLink performance.

EclipseLink performance is tracked through several mechanisms.

  • Milestone concurrency regression unit tests.
  • Milestone performance regression unit tests.
  • Public standard benchmarks such as SPECjAppServer ®.

Tests

ComponentTestDescription
CorePerformanceComparisonModelCompares the performance of different operations (reading vs batch reading)
CorePerformanceTestModelCompares performance for each test against previous result.
CoreConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
CoreConcurrencyRegressionTestModelCompares concurrnecy for each test against previous result.
JPAJPAPerformanceRegressionModelCompares performance for each test against previous result.
JPAJPAConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
JPAJPAIsolatedPerformanceRegressionModelCompares performance without caching.
JPAHibernateJPAPerformanceRegressionModelCompares EclipseLink with Hibernate.
JPAOpenJPAJPAPerformanceRegressionModelCompares EclipseLink with OpenJPA.
JPAEssentialsJPAPerformanceRegressionModelCompares EclipseLink with TopLink Essentials.
JPATopLinkJPAPerformanceRegressionModelCompares EclipseLink with TopLink.
JPAJPAMemoryLeakModelTests for possible memory leaks in EclipseLink.

Links

Copyright © Eclipse Foundation, Inc. All Rights Reserved.