-
Notifications
You must be signed in to change notification settings - Fork 108
Jakarta EE 9.1 TCK results
CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/44/ and https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/45/) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1333/testReport/ and https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1336/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1333/pipeline and https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1336/pipeline/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result :
| Test group | Failure count | Issue link(s) | Comments |
|---|---|---|---|
| jaxrs | 8 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/640 | Galssfish PR https://github.com/eclipse-ee4j/glassfish/pull/23432 has been merged |
| webservices12 | 6 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/649 | |
| Total failure count | 14 |
Note:
- Below testsuites ran without any failure's : assembly appclient concurrency connector ejb ejb30/bb ejb30/lite/appexception ejb30/lite/async ejb30/lite/basic ejb30/lite/ejbcontext ejb30/lite/enventry ejb30/lite/interceptor ejb30/lite/lookup ejb30/lite/naming ejb30/lite/nointerface ejb30/lite/packaging ejb30/lite/singleton ejb30/lite/stateful ejb30/lite/tx ejb30/lite/view ejb30/lite/xmloverride ejb30/assembly ejb30/timer ejb30/webservice ejb30/zombie ejb30/misc ejb30/sec ejb32 el integration jacc jaspic javaee javamail jbatch jdbc_appclient jdbc_ejb jdbc_jsp jdbc_servlet jms jpa_appmanaged jpa_appmanagedNoTx jpa_pmservlet jpa_puservlet jpa_stateful3 jpa_stateless3 jsf jsonb jsonp jsp jstl jta rmiiiop samples securityapi servlet signaturetest/javaee webservices13 websocket xa
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/46/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1338/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1338/pipeline
Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip
JDK Version: JDK8
Result : All Tests Pass!
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/10/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1337/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1337/pipeline
Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
JDK Version: JDK11
Result : All Tests Pass!
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/43/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result : There is no failure while there is a total of 31 errors observed for jaxws.
CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/30) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1297/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1297/pipeline
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result :
Note:
- Issue raised for loading derby classes - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627 has been fixed and closed.
- Below testsuites ran without any failure's : appclient,assembly,concurrency,connector,ejb30/assembly,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/misc,ejb30/zombie,ejb32,el,integration,jacc,jaspic,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jta,rmiiiop,samples,websocket,xa
- With the latest run https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1314/, for webservices12, now total test failures are 120.
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/40/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1323/testReport]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1323/pipeline/155
Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip
JDK Version: JDK8
Result :
| Test group | Failure count | Issue link(s) |
|---|---|---|
| webservices12 | 1 | |
| Total failure count | 1 |
Note:
- Below TCK's ran without any failure's : assembly,appclient,concurrency,connector,ejb,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/assembly,ejb30/timer,ejb30/webservice,ejb30/zombie,ejb30/misc,ejb30/sec,ejb32,el,integration,jacc,jaspic,jaxrs,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jstl,jta,rmiiiop,samples,securityapi,servlet,signaturetest/javaee,webservices13,websocket,xa
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/7/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1299/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1299/pipeline/107
Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
JDK Version: JDK11
Result :
| Test group | Failure count | Issue link(s) | Comments |
|---|---|---|---|
| jstl | 29 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 | Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/) |
| securityapi | 20 | https://github.com/eclipse-ee4j/glassfish/issues/23418 | Fix PR has been merged (https://github.com/eclipse-ee4j/glassfish/pull/23423) |
| signaturetest/javaee | 2 | ||
| Total failure count | 51 |
Note:
- Below TCK's ran without any failure's : connector,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton/concurrency,ejb30/lite/singleton/dependson,ejb30/lite/singleton/lifecycle,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb32,el,jacc,jaspic,javamail,jaxrs,jdbc,jpa,jsf,jsonb,jsonp,jsp,jta,samples,servlet,websocket
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/35/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
| Test group | Failure count | Issue link(s) | Comments |
|---|---|---|---|
| authentication-tck | 38 | https://github.com/eclipse-ee4j/glassfish/issues/23412 | With 3.0.0-b01 webservices-osgi.jar issue shouldn't be seen. more details can be found here - https://github.com/eclipse-ee4j/glassfish/issues/23412#issuecomment-801129882 |
| restful-ws-tck | 14 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/640 | |
| security-tck | 20 | https://github.com/eclipse-ee4j/glassfish/issues/23418 | Fix PR has been merged |
| tags-tck | 29 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 | Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/) |
| xml-ws-tck | 852 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/649 | Fix PR has been merged (https://github.com/eclipse-ee4j/jakartaee-tck/pull/662) |
| Total failure count | 953 |
Note:
- Below TCK's ran without any failure's: annotations-tck,authorization-tck,concurrency-tck,connectors-tck,expression-language-tck,faces-tck,jsonb-tck,jsonp-tck,messaging-tck,pages-tck,persistence-tck,servlet-tck,soap-tck,transactions-tck,websocket-tck
- There is a total of 851 errors observed for xml-ws-tck.
CI Job: https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/120/
Profile: FULL
CI Job: https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/121/
Profile: WEB
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
JDK Version: JDK11
Result: All Tests Pass!
CI Job: eftl-jakartaeetck-run-910/24 with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1275/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1275/pipeline/158
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result :
| Test group | Failure count | Issue link(s) |
|---|---|---|
| appclient | 12 | |
| concurrency | 14 | |
| ejb | 1,444 | |
| ejb30/lite/packaging | 32 | |
| ejb30/lite/tx | 163 | |
| ejb30/sec | 87 | |
| ejb30/timer | 2 | |
| ejb30/webservice | 3 | |
| ejb32 | 8 | |
| integration | 6 | |
| jacc | 40 | |
| jaxrs | 46 | |
| jbatch | 18 | |
| jdbc_appclient | 1,193 | |
| jdbc_ejb | 1,193 | |
| jdbc_jsp | 1,193 | |
| jdbc_servlet | 1,193 | |
| jpa_appmanaged | 1,715 | |
| jpa_appmanagedNoTx | 1,854 | |
| jpa_pmservlet | 1,863 | |
| jpa_puservlet | 1,852 | |
| jpa_stateful3 | 1,715 | |
| jpa_stateless3 | 1,865 | |
| jstl | 121 | |
| jta | 18 | |
| samples | 3 | |
| securityapi | 28 | |
| servlet | 9 | |
| signaturetest/javaee | 4 | |
| webservices12 | 126 | |
| webservices13 | 53 | |
| xa | 45 | |
| Total failure count | 17,918 |
Note:
- Most Full Profile Platform TCK failures are due to derby classes, more details can be found with issue here - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627
- Below TCK's ran without any failure's : assembly,connector,ejb30/assembly,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/misc,ejb30/zombie,el,jaspic,javaee,javamail,jms,jsf,jsonb,jsonp,jsp,rmiiiop,websocket
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/25/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1281/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1281/pipeline/131
Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip
JDK Version: JDK8
Result :
| test group | failure count | issue link(s) |
|---|---|---|
| jaxrs | 38 | |
| servlet | 2 | |
| webservices12 | 1 | |
| Total failure count | 41 |
Note:
- Below TCK's ran without any failure's : assembly,appclient,concurrency,connector,ejb,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/assembly,ejb30/timer,ejb30/webservice,ejb30/zombie,ejb30/misc,ejb30/sec,ejb32,el,integration,jacc,jaspic,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jstl,jta,rmiiiop,samples,securityapi,signaturetest/javaee,webservices13,websocket,xa
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/5/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1272/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1272/pipeline/107
Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
Result :
| Test group | Failure count | Issue link(s) |
|---|---|---|
| ejb30/lite/packaging | 31 | |
| ejb30/lite/tx | 163 | |
| ejb32 | 8 | |
| jacc | 24 | |
| jdbc | 2,386 | |
| jpa | 1,878 | |
| jstl | 121 | |
| samples | 1 | |
| securityapi | 28 | |
| signaturetest/javaee | 2 | |
| Total failure count | 4,642 |
Note:
- Most Web Profile Platform TCK failures are due to derby classes, more details can be found with issue here - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627
- Below TCK's ran without any failure's : connector,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton/concurrency,ejb30/lite/singleton/dependson,ejb30/lite/singleton/lifecycle,ejb30/lite/stateful,ejb30/lite/view,ejb30/lite/xmloverride,el,jaspic,javamail,jaxrs,jsf,jsonb,jsonp,jsp,jta,servlet,websocket
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/25/
CDITCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/119/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
| Test group | Failure count | Issue link(s) |
|---|---|---|
| authentication-tck | 81 | https://github.com/eclipse-ee4j/glassfish/issues/23412 |
| authorization-tck | 31 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/642 |
| pages-tck | 2 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/624 |
| restful-ws-tck | 14 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/640 |
| security-tck | 20 | https://github.com/eclipse-ee4j/glassfish/issues/23418 |
| servlet-tck | 2 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/625 |
| tags-tck | 29 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 |
| xml-ws-tck | 852 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/649 |
| cditck-porting | 7 | https://github.com/eclipse-ee4j/cditck-porting/issues/25 |
| Total failure count | 1038 |
Note:
- Below TCK's ran without any failure's: annotations-tck,concurrency-tck,connectors-tck,expression-language-tck,faces-tck,jsonb-tck,jsonp-tck,messaging-tck,persistence-tck,transactions-tck,websocket-tck
- There is a total of 851 errors observed for xml-ws-tck.
Glassfish Bundle Used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JAXB-TCK (CI Job): https://ci.eclipse.org/jakartaee-tck/job/jaxb-tck/job/master/82/
DSOL-TCK (CI Job): https://ci.eclipse.org/jakartaee-tck/job/debugging-support-for-other-languages-tck/job/master/258/
DITCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/ditck-porting/job/master/114/
BVTCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/bvtck-porting/job/master/108/
Result: All Tests Pass!
commit 26bfe1ac26e7093d02e87b394e94e6ee72ed1345
Merge: f23c73484 17530e319
Author: Gaurav Gupta <gaurav.gupta@payara.fish>
Date: Sat Mar 6 21:32:32 2021 +0530
Merge pull request #23409 from arjantijms/subjectdn
Replace the denigrated getSubjectDN by getSubjectX500Principal
Result: ...
Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).