Difference between revisions of "EclipseLink/Development/Performance"

From Eclipsepedia

Jump to: navigation, search
(Results)
(Results)
 
(8 intermediate revisions by 2 users not shown)
Line 18: Line 18:
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
<tr><td>Core</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
+
<tr><td>JPA</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
Line 28: Line 28:
  
 
====Results====
 
====Results====
* [http://stame02.us.oracle.com/eclipselink/ Weekly Performance Test Results (on Oracle)]
+
* [[/Results/1.0/|Results comparing EclipseLink 1.0 with TopLink® Essentials]]
 
+
* [[/Results/1.1/|Results comparing EclipseLink 1.1 with EclipseLink 1.0]]
 
+
* [[/Results/1.2/|Results comparing EclipseLink 1.2 with EclipseLink 1.1]]
<table border=1 cellspacing=0 cellpadding=2>
+
* [[/Results/2.0/|Results comparing EclipseLink 2.0 with EclipseLink 1.2]]
<tr style="background:#ffdead">
+
* [[/Results/2.1/|Results comparing EclipseLink 2.1 with EclipseLink 2.0]]
<td>Date last run</td> <td>Test</td> <td>Build</td> <td>Baseline</td> <td>Machine</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Pass</td> <td>Error</td> <td>Fail</td> <td>Warning</td> <td>Total</td> <td>Success</td>
+
</tr>
+
 
+
<tr>
+
<td>2009-02-25</td> <td>JPAPerformanceRegressionModel</td> <td>1.1:RC1</td> <td>1.0.0</td> <td>AMD</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 10.2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>40</td> <td>0</td> <td>0</td> <td>0</td> <td>40</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2009-02-25</td> <td>JPAConcurrencyComparisonModel</td> <td>1.1:RC1</td> <td>1.0.0</td> <td>AMD</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 10.2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>34</td> <td>0</td> <td>0</td> <td>0</td> <td>34</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2009-02-03</td> <td>PerformanceTestModel</td> <td>1.1:RC1</td> <td>1.0.0</td> <td>AMD</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 10.2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>53</td> <td>0</td> <td>0</td> <td>0</td> <td>53</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-25</td> <td>PerformanceComparisonModel</td> <td>1.0:20080725</td> <td></td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>19</td> <td>0</td> <td>0</td> <td>2</td> <td>21</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-11</td> <td>PerformanceTestModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-11</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>41</td> <td>0</td> <td>0</td> <td>0</td> <td>41</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-11</td> <td>JPAMemoryLeakModel</td> <td>1.0:20080711</td> <td></td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>4</td> <td>0</td> <td>0</td> <td>0</td> <td>4</td> <td>Passed</td>
+
</tr>
+
 
+
 
+
</table>
+
  
 
===Links===
 
===Links===
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
 
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Technology&product=EPS%28EclipseLink%29&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
+
* [[EclipseLink/DesignDocs/221546(2.0)|EclipseLink 2.0 Performance project]]
 +
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=RT&component=Foundation&component=JPA&product=EclipseLink&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
  
 
[[Category:EclipseLink|Performance]]
 
[[Category:EclipseLink|Performance]]

Latest revision as of 14:44, 12 January 2011

Contents

[edit] Performance

This is the main development page for EclipseLink performance.

EclipseLink performance is tracked through several mechanisms.

  • Weekly regression performance unit tests.
  • Milestone third party product performance unit tests comparisons.
  • Milestone concurrency regression unit tests.
  • Milestone performance regression unit tests.
  • Public standard benchmarks such as SPECjAppServer ®.

[edit] Tests

ComponentTestDescription
CorePerformanceComparisonModelCompares the performance of different operations (reading vs batch reading)
CorePerformanceTestModelCompares performance for each test against previous result.
CoreConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
CoreConcurrencyRegressionTestModelCompares concurrnecy for each test against previous result.
JPAJPAPerformanceRegressionModelCompares performance for each test against previous result.
JPAJPAConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
JPAJPAIsolatedPerformanceRegressionModelCompares performance without caching.
JPAHibernateJPAPerformanceRegressionModelCompares EclipseLink with Hibernate.
JPAOpenJPAJPAPerformanceRegressionModelCompares EclipseLink with OpenJPA.
JPAEssentialsJPAPerformanceRegressionModelCompares EclipseLink with TopLink Essentials.
JPATopLinkJPAPerformanceRegressionModelCompares EclipseLink with TopLink.
JPAJPAMemoryLeakModelTests for possible memory leaks in EclipseLink.

[edit] Results

[edit] Links