Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "EclipseLink/Development/Performance"

(Results)
(Results)
(8 intermediate revisions by 2 users not shown)
Line 18: Line 18:
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>Core</td><td>ConcurrencyRegressionTestModel</td><td>Compares concurrnecy for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
 
<tr><td>JPA</td><td>JPAPerformanceRegressionModel</td><td>Compares performance for each test against previous result.</td></tr>
<tr><td>Core</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
+
<tr><td>JPA</td><td>JPAConcurrencyComparisonTestModel</td><td>Compares concurrency for each test using 1 to 32 threads.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>JPAIsolatedPerformanceRegressionModel</td><td>Compares performance without caching.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
 
<tr><td>JPA</td><td>HibernateJPAPerformanceRegressionModel</td><td>Compares EclipseLink with Hibernate.</td></tr>
Line 28: Line 28:
  
 
====Results====
 
====Results====
* [http://stame02.us.oracle.com/eclipselink/ Weekly Performance Test Results (on Oracle)]
+
* [[/Results/1.0/|Results comparing EclipseLink 1.0 with TopLink® Essentials]]
 
+
* [[/Results/1.1/|Results comparing EclipseLink 1.1 with EclipseLink 1.0]]
 
+
* [[/Results/1.2/|Results comparing EclipseLink 1.2 with EclipseLink 1.1]]
<table border=1 cellspacing=0 cellpadding=2>
+
* [[/Results/2.0/|Results comparing EclipseLink 2.0 with EclipseLink 1.2]]
<tr style="background:#ffdead">
+
* [[/Results/2.1/|Results comparing EclipseLink 2.1 with EclipseLink 2.0]]
<td>Date last run</td> <td>Test</td> <td>Build</td> <td>Baseline</td> <td>Machine</td> <td>Server</td> <td>JDK</td> <td>Database</td> <td>OS</td> <td>Ran by</td> <td>Runner</td> <td>Pass</td> <td>Error</td> <td>Fail</td> <td>Warning</td> <td>Total</td> <td>Success</td>
+
</tr>
+
 
+
<tr>
+
<td>2009-02-25</td> <td>JPAPerformanceRegressionModel</td> <td>1.1:RC1</td> <td>1.0.0</td> <td>AMD</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 10.2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>40</td> <td>0</td> <td>0</td> <td>0</td> <td>40</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2009-02-25</td> <td>JPAConcurrencyComparisonModel</td> <td>1.1:RC1</td> <td>1.0.0</td> <td>AMD</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 10.2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>34</td> <td>0</td> <td>0</td> <td>0</td> <td>34</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2009-02-03</td> <td>PerformanceTestModel</td> <td>1.1:RC1</td> <td>1.0.0</td> <td>AMD</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 10.2</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>53</td> <td>0</td> <td>0</td> <td>0</td> <td>53</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-25</td> <td>PerformanceComparisonModel</td> <td>1.0:20080725</td> <td></td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>19</td> <td>0</td> <td>0</td> <td>2</td> <td>21</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-11</td> <td>PerformanceTestModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>62</td> <td>0</td> <td>0</td> <td>0</td> <td>62</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-11</td> <td>JPAPerformanceRegressionModel</td> <td>1.0:20080711</td> <td>1.0:20080704</td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>41</td> <td>0</td> <td>0</td> <td>0</td> <td>41</td> <td>Passed</td>
+
</tr>
+
<tr>
+
<td>2008-07-11</td> <td>JPAMemoryLeakModel</td> <td>1.0:20080711</td> <td></td> <td>QA</td> <td>JSE</td> <td>Sun JDK 1.5</td> <td>Oracle 11.1.0.6</td> <td>Linux</td> <td>QA</td> <td>ant</td> <td>4</td> <td>0</td> <td>0</td> <td>0</td> <td>4</td> <td>Passed</td>
+
</tr>
+
 
+
 
+
</table>
+
  
 
===Links===
 
===Links===
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546|EclipseLink 1.0 Performance project]]
 
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
 
* [[EclipseLink/DesignDocs/221546(1.1)|EclipseLink 1.1 Performance project]]
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Technology&product=EPS%28EclipseLink%29&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
+
* [[EclipseLink/DesignDocs/221546(2.0)|EclipseLink 2.0 Performance project]]
 +
* [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=RT&component=Foundation&component=JPA&product=EclipseLink&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=performance&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= Open performance bugs]
  
 
[[Category:EclipseLink|Performance]]
 
[[Category:EclipseLink|Performance]]

Revision as of 14:44, 12 January 2011

Performance

This is the main development page for EclipseLink performance.

EclipseLink performance is tracked through several mechanisms.

  • Weekly regression performance unit tests.
  • Milestone third party product performance unit tests comparisons.
  • Milestone concurrency regression unit tests.
  • Milestone performance regression unit tests.
  • Public standard benchmarks such as SPECjAppServer ®.

Tests

ComponentTestDescription
CorePerformanceComparisonModelCompares the performance of different operations (reading vs batch reading)
CorePerformanceTestModelCompares performance for each test against previous result.
CoreConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
CoreConcurrencyRegressionTestModelCompares concurrnecy for each test against previous result.
JPAJPAPerformanceRegressionModelCompares performance for each test against previous result.
JPAJPAConcurrencyComparisonTestModelCompares concurrency for each test using 1 to 32 threads.
JPAJPAIsolatedPerformanceRegressionModelCompares performance without caching.
JPAHibernateJPAPerformanceRegressionModelCompares EclipseLink with Hibernate.
JPAOpenJPAJPAPerformanceRegressionModelCompares EclipseLink with OpenJPA.
JPAEssentialsJPAPerformanceRegressionModelCompares EclipseLink with TopLink Essentials.
JPATopLinkJPAPerformanceRegressionModelCompares EclipseLink with TopLink.
JPAJPAMemoryLeakModelTests for possible memory leaks in EclipseLink.

Results

Links

Copyright © Eclipse Foundation, Inc. All Rights Reserved.