Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "EclipseLink/Development/Performance"

(Performance)
 
(19 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=Performance=
 
 
 
This is the main development page for EclipseLink performance.
 
This is the main development page for EclipseLink performance.
  
EclipseLink performance is tracked through several mechanism.
+
EclipseLink performance is tracked through several mechanisms.
* Weekly regression performance unit tests.
+
* Milestone third party product performance unit tests comparisons.
+
 
* Milestone concurrency regression unit tests.
 
* Milestone concurrency regression unit tests.
 
* Milestone performance regression unit tests.
 
* Milestone performance regression unit tests.
Line 18: Line 14:
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 +
<tr><td>JPA</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 +
<tr><td>JPA</td><td>OpenJPAJPAPerformanceRegressionModel</td><td>Compares EclipseLink with OpenJPA.</td></tr>
 
<tr><td>JPA</td><td>EssentialsJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink Essentials.</td></tr>
 
<tr><td>JPA</td><td>EssentialsJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink Essentials.</td></tr>
 
<tr><td>JPA</td><td>TopLinkJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink.</td></tr>
 
<tr><td>JPA</td><td>TopLinkJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink.</td></tr>
 
<tr><td>JPA</td><td>JPAMemoryLeakModel</td><td>Tests for possible memory leaks in EclipseLink.</td></tr>
 
<tr><td>JPA</td><td>JPAMemoryLeakModel</td><td>Tests for possible memory leaks in EclipseLink.</td></tr>
</table>
 
 
====Results====
 
* [http://stame02.us.oracle.com/eclipselink/ Weekly Performance Test Results (on Oracle)]
 
 
 
<table border=1 cellspacing=0 cellpadding=2>
 
<tr style="background:#ffdead">
 
<td>Date last run</td> <td>Test</td> <td>Build</td> <td>Baseline</td> <td>Machine</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Pass</td> <td>Error</td> <td>Fail</td> <td>Warning</td> <td>Total</td> <td>Success</td>
 
</tr>
 
 
<tr>
 
<td>2008-07-11</td> <td>PerformanceTestModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-07-11</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>41</td> <td>0</td> <td>0</td> <td>0</td> <td>41</td> <td>Passed</td>
 
</tr>
 
<tr>
 
<td>2008-07-11</td> <td>JPAMemoryLeakModel</td> <td>1.0:20080711</td> <td></td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>4</td> <td>0</td> <td>0</td> <td>0</td> <td>4</td> <td>Passed</td>
 
</tr>
 
 
 
<tr>
 
<td>2008-05-10</td> <td>PerformanceTestModel</td> <td>1.0:20080509</td> <td>1.0:20080502</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>61</td> <td>1</td> <td>0</td> <td>0</td> <td>62</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-05-10</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080509</td> <td>1.0:20080502</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>38</td> <td>5</td> <td>2</td> <td>0</td> <td>45</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-03-18</td> <td>ConcurrencyComparisonTestModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>13</td> <td>1</td> <td>0</td> <td>0</td> <td>14</td> <td>Ok</td>
 
</tr>
 
<tr>
 
<td>2008-03-06</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>45</td> <td>0</td> <td>0</td> <td>0</td> <td>45</td> <td>Passed</td>
 
</tr>
 
<tr>
 
<td>2008-03-02</td> <td>PerformanceTestModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR1</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Passed</td>
 
</tr>
 
 
</table>
 
</table>
  
 
===Links===
 
===Links===
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Technology&product=EPS%28EclipseLink%29&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
+
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
 +
* [[EclipseLink/DesignDocs/221546(2.0)|EclipseLink 2.0 Performance project]]
 +
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=RT&component=Foundation&component=JPA&product=EclipseLink&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
  
 
[[Category:EclipseLink|Performance]]
 
[[Category:EclipseLink|Performance]]

Latest revision as of 09:23, 23 July 2014

This is the main development page for EclipseLink performance.

EclipseLink performance is tracked through several mechanisms.

  • Milestone concurrency regression unit tests.
  • Milestone performance regression unit tests.
  • Public standard benchmarks such as SPECjAppServer ®.

Tests

ComponentTestDescription
CorePerformanceComparisonModelCompares the performance of different operations (reading vs batch reading)
CorePerformanceTestModelCompares performance for each test against previous result.
CoreConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
CoreConcurrencyRegressionTestModelCompares concurrnecy for each test against previous result.
JPAJPAPerformanceRegressionModelCompares performance for each test against previous result.
JPAJPAConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
JPAJPAIsolatedPerformanceRegressionModelCompares performance without caching.
JPAHibernateJPAPerformanceRegressionModelCompares EclipseLink with Hibernate.
JPAOpenJPAJPAPerformanceRegressionModelCompares EclipseLink with OpenJPA.
JPAEssentialsJPAPerformanceRegressionModelCompares EclipseLink with TopLink Essentials.
JPATopLinkJPAPerformanceRegressionModelCompares EclipseLink with TopLink.
JPAJPAMemoryLeakModelTests for possible memory leaks in EclipseLink.

Links

Back to the top