Jump to: navigation, search

Difference between revisions of "WTP/Build/WTP Build Break Board"

< WTP‎ | Build
(I20080320095049)
 
(15 intermediate revisions by 6 users not shown)
Line 3: Line 3:
 
The purpose of this board is to track the list of breakages that we have on our weekly I builds.  Compile, JUnit, respin requests that cause a delay in smoketest and thus declaration of our builds.  We hope to find a pattern with these breakages so that we can learn from them and the same mistakes can be avoided in future.
 
The purpose of this board is to track the list of breakages that we have on our weekly I builds.  Compile, JUnit, respin requests that cause a delay in smoketest and thus declaration of our builds.  We hope to find a pattern with these breakages so that we can learn from them and the same mistakes can be avoided in future.
  
=== M6 03/20 ===
+
=== M7 04/17 ===
==== I20080320095049====
+
==== I20080424061315 ====
 
{| border="3"   
 
{| border="3"   
 
! width="10%" | Project  
 
! width="10%" | Project  
Line 11: Line 11:
  
 
|-
 
|-
! JSF
+
! Server tools
| Respin requested for this build to address regression defect 223399.  This change should not affect any other team.
+
| 1 JUnit compile failure in org.eclipse.jst.server.core.tests.impl.TestWebModule
| GK - As part of the JSF facet installation, we add servlet and mapping entries to the web model.  We were apparently using the model provider API's incorrectly, and when a change was made in javaee code, we broke.
+
| Bug 213187 - Committer didn't have JUnit project checked out or run when making fix/TdB
|-
+
! JEE
+
| 4 Junit failures in JEE org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
+
| Carl A -I just recommented out the two test cases that have been repeatedly failing in the recent I builds - bug https://bugs.eclipse.org/bugs/show_bug.cgi?id=222626 is tracking this problem.  (Unfortunately, we have been unable to recreate the failures locally, but we will continue to investigate.)  These failures should not hold up the smoke test, and this change has been released for a build.
+
 
|}
 
|}
  
=== M6 03/13 ===
 
==== I20080317220921 ====
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
 
|-
 
! JEE
 
| Respin for this build as needed to address regression defect 222681/222321
 
| ccc - Chuck put in code for bug 222321 that released the EMF models associated with a resource when the resource was written or deleted.  Unfortunately, it released all of the Java EMF models when a jar was written or deleted (there were checks for .class and .java, but not .jar)  It caused bug 222681.
 
|- 
 
! Java EE
 
| 2 Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
 
| ccc - this is another random failure- see bug 221798
 
|}
 
  
==== I20080314073909 ====
+
==== I20080417052146 ====
 
{| border="3"   
 
{| border="3"   
 
! width="10%" | Project  
 
! width="10%" | Project  
Line 44: Line 24:
  
 
|-
 
|-
! JEM
 
| 28 Junit failure in org.eclipse.jem.tests.AllSuites
 
| ccc - 28 of these errors appear to be specific to the build machine.  Opened 222630 to address the other 2 errors - should not block smoke test
 
|- 
 
! Java EE
 
| 2 Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
 
| ccc - random failure, should not block smoke test
 
|}
 
 
==== I20080314031658 ====
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
 
|-
 
! JSF
 
| 73 compile errors in org.eclipse.jst.jsf.metadata.tests
 
116 compile errors in org.eclipse.jst.pagedesigner.tests
 
|
 
|-
 
! JEM
 
| 28 Junit failure in org.eclipse.jem.tests.AllSuites
 
| ccc - 28 of these errors appear to be specific to the build machine.  Opened 222630 to address the other 2 errors - should not block smoke test
 
|-
 
! JSF
 
| 293 Junit failures probably due to compile errors in the jsf test suites
 
6 Junit failures in org.eclipse.jst.jsf.contentassist.tests.AllTests
 
3 Junit failures in org.eclipse.jst.jsf.core.tests.AllTests
 
3 Junit failures in org.eclipse.jst.jsf.designtime.tests.AllTests
 
153 Junit failures in org.eclipse.jst.jsf.metadata.tests.AllTests
 
2 Junit failures in org.eclipse.jst.jsf.ui.tests.JSFUIAllTests
 
9 Junit failures in org.eclipse.jst.jsf.validation.el.tests.AllTests_1_1
 
9 Junit failures in org.eclipse.jst.jsf.validation.el.tests.AllTests_1_2
 
108 Junit failures in org.eclipse.jst.pagedesigner.tests.AllTests
 
|
 
|}
 
 
==== I20080313204547 ====
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials 
 
 
|-
 
! JEM
 
| 28 Junit failure in org.eclipse.jem.tests.AllSuites
 
| ccc - 28 of these errors appear to be specific to the build machine.  Opened 222630 to address the other 2 errors - should not block smoke test
 
|}
 
 
 
 
==== I20080313162923====
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials 
 
 
|-
 
! JEM
 
| 30 Junit failure in org.eclipse.jem.tests.AllSuites
 
| ccc - 28 of these errors appear to be specific to the build machine.  Opened 222630 to address the other 2 errors - should not block smoke test
 
|- 
 
! Java EE
 
| 2 Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
 
| ccc - I opened 222626 to address these JUnit issues - should not block smoke test
 
|}
 
 
==== I20080313113126 ====
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials 
 
 
|-
 
! JEM
 
| 30 Junit failure in org.eclipse.jem.tests.AllSuites
 
| ccc - 28 of these errors appear to be specific to the build machine.  Opened 222630 to address the other 2 errors - should not block smoke test
 
|- 
 
! Java EE
 
| 2 Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
 
| ccc - I opened 222626 to address these JUnit issues - should not block smoke test
 
|- 
 
! Source Editing (DTD)
 
| I Junit failure in org.eclipse.wst.dtd.core.tests.DTDCoreTestSuite
 
| '/resources' folder containing new sample DTD was not in dtd.core.tests' build.properties, will not affect smoke testing. (ND)
 
|}
 
 
==== I20080313063042====
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials 
 
 
|-
 
! JEM
 
| 30 Junit failure in org.eclipse.jem.tests.AllSuites
 
| ccc - 28 of these errors appear to be specific to the build machine.  Opened 222630 to address the other 2 errors - should not block smoke test
 
|- 
 
! Java EE
 
| 2 Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
 
| ccc - I opened 222626 to address these JUnit issues - should not block smoke test
 
|- 
 
! JSF
 
| DNF in org.eclipse.jst.jsf.facesconfig.ui.test.AllTestCases
 
|
 
|- 
 
! Source Editing (DTD)
 
| I Junit failure in org.eclipse.wst.dtd.core.tests.DTDCoreTestSuite
 
| '/resources' folder containing new sample DTD was not in dtd.core.tests' build.properties, will not affect smoke testing. (ND)
 
|}
 
 
=== M6 03/06 ===
 
==== I20080306065043====
 
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials 
 
 
|-
 
! JPT
 
| 1 Junit failure in org.eclipse.jpt.core.tests.internal.JptCoreTests
 
1 Junit failure in org.eclipse.jpt.utility.tests.internal.JptUtilityTests
 
| JptCoreTests - random failure of spurious nature, will comment out if it continues to fail
 
JptUtilityTests - Package was not exported in manifest.  Workspace tests did not reveal the problem.  Need to run strict in workspace tests to identify this type of issue beforehand.  Local build test run did catch the problem, but it was ignored and released anyway, assuming it was a local config problem.  - njh
 
|- 
 
 
! JEE
 
! JEE
| 2 random Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
+
| 4 Junit failures in JEE org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
|  
+
| testDeleteModuleDependencyWithMarker - random failure - DependencyGraphManager does not report dependency between P/TestEAR and P/TestWeb <br>testRenameModuleDependencyWithMarker - random failure - DependencyGraphManager does not report dependency between P/TestEAR and P/newUtil /ccc
testAddFilter_Web25_Defaults - random failure - expected:<1> but was:<0> [https://bugs.eclipse.org/221798 221798]
+
 
+
testMultipleEARUtilDelete - random failure - Source project P/TestEAR1 still has project reference to P/TestUtil - ccc
+
|}
+
 
+
==== I20080306160447 ====
+
{| border="3" 
+
! width="10%" | Project
+
! width="30%" | Error Type Compile/JUnit/Respin
+
! Analysis/Initials 
+
 
+
 
|-
 
|-
! JPT
+
! JSP
| 1 Junit failure in org.eclipse.jpt.core.tests.internal.JptCoreTests
+
| 1 Junit failure in org.eclipse.jst.jsp.core.tests.JSPCoreTestSuite
| The JPT Utility test has been fixed.  The remaining JPT model test failure is a bit more interesting.  Since this test has failed again (2 consecutive fails after 7 consecutive passes), it is possible that a recent change by us or in the facet or artifact edit frameworks is causing this failureUnfortunately, we are unable to reproduce this failure locally using all of the latest code from WTP. 
+
| Appears to be completely random--no changes in the component since 4/10Even a sweep changing printStackTrace()s to failures resulted in nothing.
 
+
I have entered bug 221757 (https://bugs.eclipse.org/bugs/show_bug.cgi?id=221757) to track the problem.  We will comment out the test and insert some debug statement in hopes of discovering the cause of the failure.  Since the problem doesn't occur locally, it should not affect the functionality of the plugin.  - Neil
+
|- 
+
! JEE
+
| 46  Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
+
|
+
|}
+
 
+
 
+
==== I20080306230652====
+
{| border="3" 
+
! width="10%" | Project
+
! width="30%" | Error Type Compile/JUnit/Respin
+
! Analysis/Initials 
+
|- 
+
! JEE
+
| 2 Junit failures in org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT
+
|
+
testAddFilter_Web25_Defaults failed again in latest build I20080306230652.
+
I have found a related exception logged in the SysErrorLog of the test logs.
+
I have open https://bugs.eclipse.org/221798 to track the issue. Kaloyan
+
|}
+
 
+
=== M6 02/28 ===
+
==== I20080228113529 ====
+
 
+
{| border="3" 
+
! width="10%" | Project
+
! width="30%" | Error Type Compile/JUnit/Respin
+
! Analysis/Initials 
+
 
+
 
|-
 
|-
! Server
+
! JSF PageDesigner
| 3 compile errors in org.eclipse.jst.server.ui.tests
+
| 1 Junit failure in org.eclipse.jst.pagedesigner.tests.AllTests
| Didn't run local junit test after removing a class. / AV
+
| The failing test in the pagedesigner area appears to be one of those intermittent, random problems
|- 
+
! JPT
+
| DNF in Junit for org.eclipse.jpt.core.tests.internal.JptCoreTests
+
| Deadlock in the tests, deleting resources. Seems to be a test issue, still investigating root cause / njh
+
|- 
+
! Server
+
| 2 Junit failures in org.eclipse.jst.server.ui.tests.AllTests
+
| Related to the compilation errors / AV
+
|-
+
! XML
+
| 1 Junit failure in org.eclipse.wst.xml.core.tests.SSEModelXMLTestSuite
+
| Changes to our line delimiter handling invalidated one of our tests.  It used to test if the default delimiter was the platform delimiter, but now the default is the one already in the document.  The document being tested was using the Windows line delimiter, so the test passed fine on Windows but would break on any other platform.  The test has been updated. /ND
+
|-
+
! Releng
+
| 1 Junit failure in org.eclipse.wtp.releng.tests.TestBuild
+
| Versioning Errors. Plugin versions went '''down''' compared to 202 release. Appeared this week since reference data was just updated, but the error has probably existed for a while. One contributing factor was perhaps that the "build failed" notifications were broken for several days (not being sent) so may have not been noticed by development teams.
+
 
|}
 
|}
 
==== I20080228162856 ====
 
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! JEE
 
| 4 JUnit failures.
 
|testAddListener_Web24_Defaults - random failure - WebProject does not exist
 
<p>testWebPublishJEE5 - random failure - Component TestUtil should have 2 component classpath dependencies, only has: 0
 
/ccc
 
|-
 
! XML
 
| 1 Junit failure in org.eclipse.wst.xml.core.tests.SSEModelXMLTestSuite
 
| Above update missed the build./ND
 
|-
 
! Releng
 
| 1 Junit failure in org.eclipse.wtp.releng.tests.TestBuild
 
| Same Versioning Errors (in JSF, Common Facet). JSF can not easily update, since other changes have been made to HEAD.
 
|}
 
 
==== I20080228214133 ====
 
 
{| border="3" 
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! JEE
 
| 2 JUnit failures.
 
|testClassFolderDependency - random failure - Component TestWeb should have 1 component classpath dependencies, only has: 0/ccc
 
|-
 
! JPT
 
| Massive compile failure. Seems a number of source files are missing?
 
| Releasing process failure.  Sync error displayed at end of release process, manual inspection looked OK but there were apparently problems (files left untagged that had moved).  Not sure what went wrong with the process (standard releng tool was used, perhaps a CVS glitch?).  Manually tagging and re-releasing changed plugins to fix the problem /njh
 
 
I also want to note this release was done only to update JavaDoc. The JPT team felt this was critical to do this week, but normally, JavaDoc changes should not be released after candidate produced, since normally that would not be a blocking or critical  problem ... so, remember ... every release is an opportunity to break something. dw
 
|-
 
! Releng
 
| 1 Junit failure in org.eclipse.wtp.releng.tests.TestBuild
 
| Same Versioning Errors (in JSF, Common Facet). JSF can not easily update, since other changes have been made to HEAD.
 
|}
 
 
==== I20080229031047 ====
 
 
{| border="3"
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! JPT
 
| Same massive compile failure as previous build. Assuming fix isn't in yet
 
| Releasing process failure.  Sync error displayed at end of release process, manual inspection looked OK but there were apparently problems (files left untagged that had moved).  Not sure what went wrong with the process (standard releng tool was used, perhaps a CVS glitch?).  Manually tagging and re-releasing changed plugins to fix the problem /njh
 
|}
 
 
==== I20080229065303 ====
 
 
{| border="3"
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! WS
 
| Respin requested based on bad bug (regression) found in smoke test.
 
|The Web Services smoke test failed due to a change in the Tomcat server tools [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220879 220879].  The problem was fixed by Server tooling team and was dropped in I20080229195548.  Based on the comments in the bug, this was due to a change in publishing in Tomcat server tools recently and was not found because testing was not done in a new workspace.  They had commented that new JUnit would be included in the next I-build to catch this in the future. (KSC)
 
|}
 
 
==== I20080229121121 ====
 
 
{| border="3"
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! releng
 
| WS fix not in yet. Unclear what kicked off this build. No change in map files from previous. Either someone did "manually", or, bug in CruiseControl.
 
| action: will keep an eye on this, and if continues to happen will experiment with CC settings, or upgrate to 2.7.2 EA, or disable manual force build. (If others committers do 'manually', for any reason, that's fine ... just let Helen or David know). dw
 
|}
 
 
==== I20080229195548 ====
 
 
{| border="3"
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! JSF
 
| JUnit breakage due to core exception while deleting project tearDown.
 
| The failure in I20080229195548 is new and indeed spurious.  It stems from the standard class of problem we have identified where project contents are being file locked in ways that previously they either weren't or in ways that are more susceptible to race conditions.  Once we get past code review I will endeavour to convert to the busy loop idiom for deleting projects across all of our JUnit tests.  CB.
 
|}
 
 
==== I20080301004930 ====
 
 
{| border="3"
 
! width="10%" | Project
 
! width="30%" | Error Type Compile/JUnit/Respin
 
! Analysis/Initials
 
|-
 
! SSE (JSP)
 
| Another, apparently 'random' error in JSP JUnits, no change in map files from previous build.
 
| Unknown, there was a failure reading in our test resources. ND
 
|}
 
 
 
 
  
  
 +
* Other milestones
 +
:[http://wiki.eclipse.org/WTP_Build_Break_Board_M6 Build Breaker Board M6]
  
  
[[Category:Eclipse Web Tools Platform Project]]
+
[[Category:WTP Build Related| ]]

Latest revision as of 23:43, 12 September 2008

WTP weekly I build breakages

The purpose of this board is to track the list of breakages that we have on our weekly I builds. Compile, JUnit, respin requests that cause a delay in smoketest and thus declaration of our builds. We hope to find a pattern with these breakages so that we can learn from them and the same mistakes can be avoided in future.

M7 04/17

I20080424061315

Project Error Type Compile/JUnit/Respin Analysis/Initials
Server tools 1 JUnit compile failure in org.eclipse.jst.server.core.tests.impl.TestWebModule Bug 213187 - Committer didn't have JUnit project checked out or run when making fix/TdB


I20080417052146

Project Error Type Compile/JUnit/Respin Analysis/Initials
JEE 4 Junit failures in JEE org.eclipse.jst.j2ee.tests.bvt.AutomatedBVT testDeleteModuleDependencyWithMarker - random failure - DependencyGraphManager does not report dependency between P/TestEAR and P/TestWeb
testRenameModuleDependencyWithMarker - random failure - DependencyGraphManager does not report dependency between P/TestEAR and P/newUtil /ccc
JSP 1 Junit failure in org.eclipse.jst.jsp.core.tests.JSPCoreTestSuite Appears to be completely random--no changes in the component since 4/10. Even a sweep changing printStackTrace()s to failures resulted in nothing.
JSF PageDesigner 1 Junit failure in org.eclipse.jst.pagedesigner.tests.AllTests The failing test in the pagedesigner area appears to be one of those intermittent, random problems


  • Other milestones
Build Breaker Board M6