Difference between revisions of "EclipseLink/Development/Performance"

From Eclipsepedia

Jump to: navigation, search
(Results)
(Results)
(23 intermediate revisions by 3 users not shown)
Line 3: Line 3:
 
This is the main development page for EclipseLink performance.
 
This is the main development page for EclipseLink performance.
  
EclipseLink performance is tracked through several mechanism.
+
EclipseLink performance is tracked through several mechanisms.
 
* Weekly regression performance unit tests.
 
* Weekly regression performance unit tests.
 
* Milestone third party product performance unit tests comparisons.
 
* Milestone third party product performance unit tests comparisons.
Line 10: Line 10:
 
* Public standard benchmarks such as [http://www.spec.org/benchmarks.html#java SPECjAppServer ®].
 
* Public standard benchmarks such as [http://www.spec.org/benchmarks.html#java SPECjAppServer ®].
  
===Testings===
+
===Tests===
 
<table border=1 cellspacing=0 cellpadding=0>
 
<table border=1 cellspacing=0 cellpadding=0>
 
<tr style="background:#ffdead"><td>Component</td><td>Test</td><td>Description</td></tr>
 
<tr style="background:#ffdead"><td>Component</td><td>Test</td><td>Description</td></tr>
Line 18: Line 18:
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 +
<tr><td>JPA</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 +
<tr><td>JPA</td><td>OpenJPAJPAPerformanceRegressionModel</td><td>Compares EclipseLink with OpenJPA.</td></tr>
 
<tr><td>JPA</td><td>EssentialsJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink Essentials.</td></tr>
 
<tr><td>JPA</td><td>EssentialsJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink Essentials.</td></tr>
 
<tr><td>JPA</td><td>TopLinkJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink.</td></tr>
 
<tr><td>JPA</td><td>TopLinkJPAPerformanceRegressionModel</td><td>Compares EclipseLink with TopLink.</td></tr>
 +
<tr><td>JPA</td><td>JPAMemoryLeakModel</td><td>Tests for possible memory leaks in EclipseLink.</td></tr>
 
</table>
 
</table>
  
 
====Results====
 
====Results====
<table border=1 cellspacing=0 cellpadding=2>
+
* [[/Results/1.0/|Results comparing EclipseLink 1.0 with TopLink® Essentials]]
<tr style="background:#ffdead">
+
* [[/Results/1.1/|Results comparing EclipseLink 1.1 with EclipseLink 1.0]]
<td>Date last run</td> <td>Test</td> <td>Build</td> <td>Baseline</td> <td>Machine</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Pass</td> <td>Error</td> <td>Fail</td> <td>Warning</td> <td>Total</td> <td>Success</td>
+
* [[/Results/1.2/|Results comparing EclipseLink 1.2 with EclipseLink 1.1]]
</tr>
+
* [[/Results/2.0/|Results comparing EclipseLink 2.0 with EclipseLink 1.2]]
<tr>
+
* [[/Results/2.1/|Results comparing EclipseLink 2.1 with EclipseLink 2.0]]
<td>2008-05-10</td> <td>PerformanceTestModel</td> <td>1.0:20080509</td> <td>1.0:20080502</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>61</td> <td>1</td> <td>0</td> <td>0</td> <td>62</td> <td>Ok</td>
+
</tr>
+
<tr>
+
<td>2008-05-10</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080509</td> <td>1.0:20080502</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>38</td> <td>5</td> <td>8</td> <td>0</td> <td>45</td> <td>Ok</td>
+
</tr>
+
<tr>
+
<td>2008-03-18</td> <td>ConcurrencyComparisonTestModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>13</td> <td>1</td> <td>0</td> <td>0</td> <td>14</td> <td>Ok</td>
+
</tr>
+
<tr>
+
<td>2008-03-06</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR2</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>45</td> <td>0</td> <td>0</td> <td>0</td> <td>45</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-03-02</td> <td>PerformanceTestModel</td> <td>1.0:20080228</td> <td>TopLink 11gR1:080218</td> <td>AMD 4-CPU</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11gR1</td> <td>Linux</td> <td>James</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Passed</td>
+
</tr>
+
</table>
+
  
 
===Links===
 
===Links===
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Technology&product=EPS%28EclipseLink%29&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
+
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
 +
* [[EclipseLink/DesignDocs/221546(2.0)|EclipseLink 2.0 Performance project]]
 +
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=RT&component=Foundation&component=JPA&product=EclipseLink&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
  
 
[[Category:EclipseLink|Performance]]
 
[[Category:EclipseLink|Performance]]

Revision as of 14:44, 12 January 2011

Contents

Performance

This is the main development page for EclipseLink performance.

EclipseLink performance is tracked through several mechanisms.

  • Weekly regression performance unit tests.
  • Milestone third party product performance unit tests comparisons.
  • Milestone concurrency regression unit tests.
  • Milestone performance regression unit tests.
  • Public standard benchmarks such as SPECjAppServer ®.

Tests

ComponentTestDescription
CorePerformanceComparisonModelCompares the performance of different operations (reading vs batch reading)
CorePerformanceTestModelCompares performance for each test against previous result.
CoreConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
CoreConcurrencyRegressionTestModelCompares concurrnecy for each test against previous result.
JPAJPAPerformanceRegressionModelCompares performance for each test against previous result.
JPAJPAConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
JPAJPAIsolatedPerformanceRegressionModelCompares performance without caching.
JPAHibernateJPAPerformanceRegressionModelCompares EclipseLink with Hibernate.
JPAOpenJPAJPAPerformanceRegressionModelCompares EclipseLink with OpenJPA.
JPAEssentialsJPAPerformanceRegressionModelCompares EclipseLink with TopLink Essentials.
JPATopLinkJPAPerformanceRegressionModelCompares EclipseLink with TopLink.
JPAJPAMemoryLeakModelTests for possible memory leaks in EclipseLink.

Results

Links