Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "EclipseLink/Development/Performance/Results/1.1"
(→JPA Performance Regression Test Suite) |
|||
| Line 88: | Line 88: | ||
</tr><tr> | </tr><tr> | ||
<td>MassInsertAddress</td><td>1.69%</td> | <td>MassInsertAddress</td><td>1.69%</td> | ||
| + | </tr><tr> | ||
| + | </tr><tr> | ||
| + | <td>UpdateAddress</td><td>n/a</td> | ||
</tr><tr> | </tr><tr> | ||
<td>InsertEmp</td><td>4.46%</td> | <td>InsertEmp</td><td>4.46%</td> | ||
| Line 93: | Line 96: | ||
<td>InsertDeleteEmp</td><td>-2.10%</td> | <td>InsertDeleteEmp</td><td>-2.10%</td> | ||
</tr> | </tr> | ||
| + | </tr><tr> | ||
| + | <td>UpdateEmployee</td><td>n/a</td> | ||
| + | </tr><tr> | ||
| + | </tr><tr> | ||
| + | <td>ComplexUpdateEmployee</td><td>n/a</td> | ||
| + | </tr><tr> | ||
</table> | </table> | ||
| Line 102: | Line 111: | ||
<td>Test</td><td>% Dif</td> | <td>Test</td><td>% Dif</td> | ||
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllAddressReadOnly</td><td> | + | <td>ReadAllAddressReadOnly</td><td>8.33%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllAddress</td><td> | + | <td>ReadAllAddress</td><td>21.37%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllAddressSimpleJPQLReadOnly</td><td> | + | <td>ReadAllAddressSimpleJPQLReadOnly</td><td>21.04%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllAddressSimpleJPQL</td><td> | + | <td>ReadAllAddressSimpleJPQL</td><td>22.29%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllAddressNamedQueryReadOnly</td><td> | + | <td>ReadAllAddressNamedQueryReadOnly</td><td>21.32%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllAddressNamedQuery</td><td> | + | <td>ReadAllAddressNamedQuery</td><td>31.28%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpReadOnly</td><td> | + | <td>ReadAllEmpReadOnly</td><td>14.62%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmp</td><td> | + | <td>ReadAllEmp</td><td>25.07%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpComplexJPQLReadOnly</td><td> | + | <td>ReadAllEmpComplexJPQLReadOnly</td><td>23.07%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpComplexJPQL</td><td> | + | <td>ReadAllEmpComplexJPQL</td><td>25.95%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpComplexDynJPQLReadOnly</td><td> | + | <td>ReadAllEmpComplexDynJPQLReadOnly</td><td>0.21%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpCompletelyReadOnly</td><td> | + | <td>ReadAllEmpCompletelyReadOnly</td><td>12.29%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpCompletely</td><td> | + | <td>ReadAllEmpCompletely</td><td>12.18%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpCompletelyJoinedReadOnly</td><td> | + | <td>ReadAllEmpCompletelyJoinedReadOnly</td><td>16.05%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllEmpCompletelyJoined</td><td> | + | <td>ReadAllEmpCompletelyJoined</td><td>14.00%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllProjectReadOnly</td><td> | + | <td>ReadAllProjectReadOnly</td><td>15.79%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllProject</td><td> | + | <td>ReadAllProject</td><td>17.56%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllSmallProjectReadOnly</td><td> | + | <td>ReadAllSmallProjectReadOnly</td><td>15.47%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllSmallProject</td><td> | + | <td>ReadAllSmallProject</td><td>16.71%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllLargeProjectReadOnly</td><td> | + | <td>ReadAllLargeProjectReadOnly</td><td>15.55%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadAllLargeProject</td><td> | + | <td>ReadAllLargeProject</td><td>17.55%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectAddress</td><td> | + | <td>ReadObjectAddress</td><td>14.46%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectGetAddress</td><td> | + | <td>ReadObjectGetAddress</td><td>31.18%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectAddressJPQLReadOnly</td><td> | + | <td>ReadObjectAddressJPQLReadOnly</td><td>25.35%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectAddressJPQL</td><td> | + | <td>ReadObjectAddressJPQL</td><td>27.04%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectAddressNamedQuery</td><td> | + | <td>ReadObjectAddressNamedQuery</td><td>34.03%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectEmp</td><td> | + | <td>ReadObjectEmp</td><td>31.24%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>ReadObjectCompletelyEmp</td><td> | + | <td>ReadObjectCompletelyEmp</td><td>24.97%</td> |
</tr><tr></tr><tr> | </tr><tr></tr><tr> | ||
| − | <td>InsertAddress</td><td> | + | <td>InsertAddress</td><td>8.48%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>InsertDeleteAddress</td><td> | + | <td>InsertDeleteAddress</td><td>11.45%</td> |
</tr><tr> | </tr><tr> | ||
| − | <td>MassInsertAddress</td><td> | + | <td>MassInsertAddress</td><td>7.29%</td> |
</tr><tr> | </tr><tr> | ||
| − | |||
</tr><tr> | </tr><tr> | ||
| − | <td> | + | <td>UpdateAddress</td><td>22.72%</td> |
| + | </tr><tr> | ||
| + | <td>InsertEmp</td><td>24.39%</td> | ||
| + | </tr><tr> | ||
| + | <td>InsertDeleteEmp</td><td>n/a</td> | ||
</tr> | </tr> | ||
| + | </tr><tr> | ||
| + | <td>UpdateEmployee</td><td>63.62%</td> | ||
| + | </tr><tr> | ||
| + | </tr><tr> | ||
| + | <td>ComplexUpdateEmployee</td><td>19.01%</td> | ||
| + | </tr><tr> | ||
</table> | </table> | ||
Revision as of 11:45, 11 March 2009
Contents
Performance Test Results Comparing EclipseLink 1.1 vs EclipseLink 1.0
This results show the % difference in performance between EclipseLink 1.1 and EclipseLink 1.0 on various performance tests.
Each test consisted of running the test in a single threaded loop and recording the number of operations in a set amount of time. The each test was run 5 times, the max and min result rejected, and the middle 3 results were averaged to obtain the result and compute the % standard deviation. The average result was then compared with the run from the other version to compute the % difference. The tests were run on a multi-CPU AMD Linux machine, accessing an Oracle 10.2 database running on Linux.
JPA Performance Regression Test Suite
This table shows the % difference between 1.1 and 1.0, a positive % means an increase in performance by x% of the 1.0 results. The tests can have a +/- variance of 2% some any increase or decrease by less than 2% is not significant.
In general the performance between 1.0 and 1.1 improved slightly, with some use cases improving significantly. These results are meant for development to verify the performance of the release, actually performance values for user applications will vary based on the hardware, environment, database, JVM, and object model.
The ReadAll tests created a JPQL Query and called getResultList() on it. The ReadObject tests either called the find() or getReference() operation, or created a JPQL Query and called getSingleResult(). The ReadOnly tests used the "eclipselink-read-only" Query hint. The insert tests performed a persist() the delete tests performed a remove(), the update tests performed a find() on the object and changed it and committed the transaction.
Tests were run in JSE 1.5, using the EclipseLink weaving agent, and default caching, and accessed an Oracle 10.2 database.
As these were single threaded performance tests, the database portion of the total test time was significant for most tests. The database access is important to measure in a performance test, but it is also useful to be able to isolate the JPA performance. To do this, the same tests were run also using an emulated database that removes the database cost for the tests. The emulated tests general show the same difference to the database tests, but the % difference is much higher. The pure JPA performance is important, because in a multi-threaded environment with the database on a separate machine, the performance of the mid-tier machine is determined by the JPA/client performance.
Database Results
</td> <td> Emulated Database Results
</td> </tr> </table> |