[VOTE] Release Apache NiFi 0.5.1 (RC1)

classic Classic list List threaded Threaded
13 messages Options
Reply | Threaded
Open this post in threaded view
|

[VOTE] Release Apache NiFi 0.5.1 (RC1)

Tony Kurc
Hello,
I am pleased to be calling this vote for the source release of Apache NiFi
nifi-0.5.1.

The source zip, including signatures, digests, etc. can be found at:
https://repository.apache.org/content/repositories/orgapachenifi-1075

The Git tag is nifi-0.5.1-RC1
The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63

This release candidate is a branch off of support/nifi-0.5.x at
2a459fe21c708c8316dd255c3dc7f8254e7940f1.

Checksums of nifi-0.5.1-source-release.zip:
MD5: 02b920f226643412cc9ff5f7103fa156
SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/tkurc.asc

KEYS file available here:
https://dist.apache.org/repos/dist/release/nifi/KEYS

11 issues were closed/resolved for this release:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887

Release note highlights can be found here:
https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1

The vote will be open for 72 hours.
Please download the release candidate and evaluate the necessary items
including checking hashes, signatures, build from source, and test.  Then
please vote:

[ ] +1 Release this package as nifi-0.5.1
[ ] +0 no opinion
[ ] -1 Do not release this package because because...

Thanks again for helping with this release!

Tony
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Pierre Villard
Hi all,

I got some issues when building the version (on Windows):
- with 'mvn clean install -Pcontrib-check', I got GC overhead limit error
on unit tests in framework-core (I didn't manage to get it working by
changing options in Maven but I guess I missed something with my own local
environment)
- with 'mvn clean install -Pcontrib-check -DskipTests', I got the following
error : [ERROR] Failed to execute goal
org.apache.rat:apache-rat-plugin:0.11:check (default) on project
nifi-standard-processors: Too many files with unapproved license: 1 See RAT
report (It comes from
nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
- with 'mvn clean install -DskipTests', it is OK.

Otherwise, as far as I looked, it seems OK to me.




2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:

> Hello,
> I am pleased to be calling this vote for the source release of Apache NiFi
> nifi-0.5.1.
>
> The source zip, including signatures, digests, etc. can be found at:
> https://repository.apache.org/content/repositories/orgapachenifi-1075
>
> The Git tag is nifi-0.5.1-RC1
> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>
> This release candidate is a branch off of support/nifi-0.5.x at
> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>
> Checksums of nifi-0.5.1-source-release.zip:
> MD5: 02b920f226643412cc9ff5f7103fa156
> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/tkurc.asc
>
> KEYS file available here:
> https://dist.apache.org/repos/dist/release/nifi/KEYS
>
> 11 issues were closed/resolved for this release:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>
> Release note highlights can be found here:
>
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>
> The vote will be open for 72 hours.
> Please download the release candidate and evaluate the necessary items
> including checking hashes, signatures, build from source, and test.  Then
> please vote:
>
> [ ] +1 Release this package as nifi-0.5.1
> [ ] +0 no opinion
> [ ] -1 Do not release this package because because...
>
> Thanks again for helping with this release!
>
> Tony
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Brian Ghigiarelli
Hi Pierre,

I'm hitting the same issues on Mac with the master branch (specifically
while it runs testManyOpenedFiles in nifi-framework-core). Been tuning Xmx,
ulimits, and G1GC to no avail. Perhaps we could continue that investigation
on a separate non-voting thread.

Thanks,
Brian

On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <[hidden email]>
wrote:

> Hi all,
>
> I got some issues when building the version (on Windows):
> - with 'mvn clean install -Pcontrib-check', I got GC overhead limit error
> on unit tests in framework-core (I didn't manage to get it working by
> changing options in Maven but I guess I missed something with my own local
> environment)
> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the following
> error : [ERROR] Failed to execute goal
> org.apache.rat:apache-rat-plugin:0.11:check (default) on project
> nifi-standard-processors: Too many files with unapproved license: 1 See RAT
> report (It comes from
>
> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
> - with 'mvn clean install -DskipTests', it is OK.
>
> Otherwise, as far as I looked, it seems OK to me.
>
>
>
>
> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>
> > Hello,
> > I am pleased to be calling this vote for the source release of Apache
> NiFi
> > nifi-0.5.1.
> >
> > The source zip, including signatures, digests, etc. can be found at:
> > https://repository.apache.org/content/repositories/orgapachenifi-1075
> >
> > The Git tag is nifi-0.5.1-RC1
> > The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> >
> > This release candidate is a branch off of support/nifi-0.5.x at
> > 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
> >
> > Checksums of nifi-0.5.1-source-release.zip:
> > MD5: 02b920f226643412cc9ff5f7103fa156
> > SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/tkurc.asc
> >
> > KEYS file available here:
> > https://dist.apache.org/repos/dist/release/nifi/KEYS
> >
> > 11 issues were closed/resolved for this release:
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
> >
> > Release note highlights can be found here:
> >
> >
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
> >
> > The vote will be open for 72 hours.
> > Please download the release candidate and evaluate the necessary items
> > including checking hashes, signatures, build from source, and test.  Then
> > please vote:
> >
> > [ ] +1 Release this package as nifi-0.5.1
> > [ ] +0 no opinion
> > [ ] -1 Do not release this package because because...
> >
> > Thanks again for helping with this release!
> >
> > Tony
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

trkurc
Administrator
often that error is because the heap is overcommitted.... What version of
the JDK are you attempting to build with, and what MAVEN_OPTS are you
using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".

On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
wrote:

> Hi Pierre,
>
> I'm hitting the same issues on Mac with the master branch (specifically
> while it runs testManyOpenedFiles in nifi-framework-core). Been tuning Xmx,
> ulimits, and G1GC to no avail. Perhaps we could continue that investigation
> on a separate non-voting thread.
>
> Thanks,
> Brian
>
> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
> [hidden email]>
> wrote:
>
> > Hi all,
> >
> > I got some issues when building the version (on Windows):
> > - with 'mvn clean install -Pcontrib-check', I got GC overhead limit error
> > on unit tests in framework-core (I didn't manage to get it working by
> > changing options in Maven but I guess I missed something with my own
> local
> > environment)
> > - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
> following
> > error : [ERROR] Failed to execute goal
> > org.apache.rat:apache-rat-plugin:0.11:check (default) on project
> > nifi-standard-processors: Too many files with unapproved license: 1 See
> RAT
> > report (It comes from
> >
> >
> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
> > - with 'mvn clean install -DskipTests', it is OK.
> >
> > Otherwise, as far as I looked, it seems OK to me.
> >
> >
> >
> >
> > 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
> >
> > > Hello,
> > > I am pleased to be calling this vote for the source release of Apache
> > NiFi
> > > nifi-0.5.1.
> > >
> > > The source zip, including signatures, digests, etc. can be found at:
> > > https://repository.apache.org/content/repositories/orgapachenifi-1075
> > >
> > > The Git tag is nifi-0.5.1-RC1
> > > The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> > >
> > > This release candidate is a branch off of support/nifi-0.5.x at
> > > 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
> > >
> > > Checksums of nifi-0.5.1-source-release.zip:
> > > MD5: 02b920f226643412cc9ff5f7103fa156
> > > SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/tkurc.asc
> > >
> > > KEYS file available here:
> > > https://dist.apache.org/repos/dist/release/nifi/KEYS
> > >
> > > 11 issues were closed/resolved for this release:
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
> > >
> > > Release note highlights can be found here:
> > >
> > >
> >
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
> > >
> > > The vote will be open for 72 hours.
> > > Please download the release candidate and evaluate the necessary items
> > > including checking hashes, signatures, build from source, and test.
> Then
> > > please vote:
> > >
> > > [ ] +1 Release this package as nifi-0.5.1
> > > [ ] +0 no opinion
> > > [ ] -1 Do not release this package because because...
> > >
> > > Thanks again for helping with this release!
> > >
> > > Tony
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Brian Ghigiarelli
Thanks, Tony!

Oracle JDK 8 u45 (1.8.0_45)

At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 clean
install" and "mvn -T C4.0 clean install"

-Xms1024m -Xmx3076m
-Xms128m -Xmx4096m
-Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
-Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
-Xmx3g -XX:-UseGCOverheadLimit

All eventually fail in the same spot:

Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 154.539
sec <<< FAILURE! - in TestSuite
testManyFilesOpened on
testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
 Time elapsed: 59.672 sec  <<< FAILURE!
java.lang.OutOfMemoryError: GC overhead limit exceeded
at
org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
at
org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
at
org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
at
org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)

This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a 3GHz i7
processor and 16GB memory.

On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:

> often that error is because the heap is overcommitted.... What version of
> the JDK are you attempting to build with, and what MAVEN_OPTS are you
> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>
> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
> wrote:
>
> > Hi Pierre,
> >
> > I'm hitting the same issues on Mac with the master branch (specifically
> > while it runs testManyOpenedFiles in nifi-framework-core). Been tuning
> Xmx,
> > ulimits, and G1GC to no avail. Perhaps we could continue that
> investigation
> > on a separate non-voting thread.
> >
> > Thanks,
> > Brian
> >
> > On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
> > [hidden email]>
> > wrote:
> >
> > > Hi all,
> > >
> > > I got some issues when building the version (on Windows):
> > > - with 'mvn clean install -Pcontrib-check', I got GC overhead limit
> error
> > > on unit tests in framework-core (I didn't manage to get it working by
> > > changing options in Maven but I guess I missed something with my own
> > local
> > > environment)
> > > - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
> > following
> > > error : [ERROR] Failed to execute goal
> > > org.apache.rat:apache-rat-plugin:0.11:check (default) on project
> > > nifi-standard-processors: Too many files with unapproved license: 1 See
> > RAT
> > > report (It comes from
> > >
> > >
> >
> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
> > > - with 'mvn clean install -DskipTests', it is OK.
> > >
> > > Otherwise, as far as I looked, it seems OK to me.
> > >
> > >
> > >
> > >
> > > 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
> > >
> > > > Hello,
> > > > I am pleased to be calling this vote for the source release of Apache
> > > NiFi
> > > > nifi-0.5.1.
> > > >
> > > > The source zip, including signatures, digests, etc. can be found at:
> > > >
> https://repository.apache.org/content/repositories/orgapachenifi-1075
> > > >
> > > > The Git tag is nifi-0.5.1-RC1
> > > > The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> > > >
> > > > This release candidate is a branch off of support/nifi-0.5.x at
> > > > 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
> > > >
> > > > Checksums of nifi-0.5.1-source-release.zip:
> > > > MD5: 02b920f226643412cc9ff5f7103fa156
> > > > SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
> > > >
> > > > Release artifacts are signed with the following key:
> > > > https://people.apache.org/keys/committer/tkurc.asc
> > > >
> > > > KEYS file available here:
> > > > https://dist.apache.org/repos/dist/release/nifi/KEYS
> > > >
> > > > 11 issues were closed/resolved for this release:
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
> > > >
> > > > Release note highlights can be found here:
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
> > > >
> > > > The vote will be open for 72 hours.
> > > > Please download the release candidate and evaluate the necessary
> items
> > > > including checking hashes, signatures, build from source, and test.
> > Then
> > > > please vote:
> > > >
> > > > [ ] +1 Release this package as nifi-0.5.1
> > > > [ ] +0 no opinion
> > > > [ ] -1 Do not release this package because because...
> > > >
> > > > Thanks again for helping with this release!
> > > >
> > > > Tony
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Brian Ghigiarelli
Upgrading to JDK 8 u74 works like a charm - everything builds and tests to
success. The fan is a lot quieter now too. Thanks for the pointer on the
JDK version!

On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <[hidden email]>
wrote:

> Thanks, Tony!
>
> Oracle JDK 8 u45 (1.8.0_45)
>
> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 clean
> install" and "mvn -T C4.0 clean install"
>
> -Xms1024m -Xmx3076m
> -Xms128m -Xmx4096m
> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
> -Xmx3g -XX:-UseGCOverheadLimit
>
> All eventually fail in the same spot:
>
> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 154.539
> sec <<< FAILURE! - in TestSuite
> testManyFilesOpened on
> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
>  Time elapsed: 59.672 sec  <<< FAILURE!
> java.lang.OutOfMemoryError: GC overhead limit exceeded
> at
> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
> at
> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
> at
> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
> at
> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
>
> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a 3GHz i7
> processor and 16GB memory.
>
> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
>
>> often that error is because the heap is overcommitted.... What version of
>> the JDK are you attempting to build with, and what MAVEN_OPTS are you
>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>>
>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
>> wrote:
>>
>> > Hi Pierre,
>> >
>> > I'm hitting the same issues on Mac with the master branch (specifically
>> > while it runs testManyOpenedFiles in nifi-framework-core). Been tuning
>> Xmx,
>> > ulimits, and G1GC to no avail. Perhaps we could continue that
>> investigation
>> > on a separate non-voting thread.
>> >
>> > Thanks,
>> > Brian
>> >
>> > On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
>> > [hidden email]>
>> > wrote:
>> >
>> > > Hi all,
>> > >
>> > > I got some issues when building the version (on Windows):
>> > > - with 'mvn clean install -Pcontrib-check', I got GC overhead limit
>> error
>> > > on unit tests in framework-core (I didn't manage to get it working by
>> > > changing options in Maven but I guess I missed something with my own
>> > local
>> > > environment)
>> > > - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
>> > following
>> > > error : [ERROR] Failed to execute goal
>> > > org.apache.rat:apache-rat-plugin:0.11:check (default) on project
>> > > nifi-standard-processors: Too many files with unapproved license: 1
>> See
>> > RAT
>> > > report (It comes from
>> > >
>> > >
>> >
>> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
>> > > - with 'mvn clean install -DskipTests', it is OK.
>> > >
>> > > Otherwise, as far as I looked, it seems OK to me.
>> > >
>> > >
>> > >
>> > >
>> > > 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>> > >
>> > > > Hello,
>> > > > I am pleased to be calling this vote for the source release of
>> Apache
>> > > NiFi
>> > > > nifi-0.5.1.
>> > > >
>> > > > The source zip, including signatures, digests, etc. can be found at:
>> > > >
>> https://repository.apache.org/content/repositories/orgapachenifi-1075
>> > > >
>> > > > The Git tag is nifi-0.5.1-RC1
>> > > > The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>> > > >
>> > > >
>> > >
>> >
>> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>> > > >
>> > > > This release candidate is a branch off of support/nifi-0.5.x at
>> > > > 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>> > > >
>> > > > Checksums of nifi-0.5.1-source-release.zip:
>> > > > MD5: 02b920f226643412cc9ff5f7103fa156
>> > > > SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>> > > >
>> > > > Release artifacts are signed with the following key:
>> > > > https://people.apache.org/keys/committer/tkurc.asc
>> > > >
>> > > > KEYS file available here:
>> > > > https://dist.apache.org/repos/dist/release/nifi/KEYS
>> > > >
>> > > > 11 issues were closed/resolved for this release:
>> > > >
>> > > >
>> > >
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>> > > >
>> > > > Release note highlights can be found here:
>> > > >
>> > > >
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>> > > >
>> > > > The vote will be open for 72 hours.
>> > > > Please download the release candidate and evaluate the necessary
>> items
>> > > > including checking hashes, signatures, build from source, and test.
>> > Then
>> > > > please vote:
>> > > >
>> > > > [ ] +1 Release this package as nifi-0.5.1
>> > > > [ ] +0 no opinion
>> > > > [ ] -1 Do not release this package because because...
>> > > >
>> > > > Thanks again for helping with this release!
>> > > >
>> > > > Tony
>> > > >
>> > >
>> >
>>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Joe Witt
+1 (binding) Release this package as nifi-0.5.1

Ran through all steps outlined for verification and validated numerous
JIRAs on the release and confirmed the finding Sean had for the
sources/javadocs has been resolved.

Thanks!

On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <[hidden email]> wrote:

> Upgrading to JDK 8 u74 works like a charm - everything builds and tests to
> success. The fan is a lot quieter now too. Thanks for the pointer on the
> JDK version!
>
> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <[hidden email]>
> wrote:
>
>> Thanks, Tony!
>>
>> Oracle JDK 8 u45 (1.8.0_45)
>>
>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 clean
>> install" and "mvn -T C4.0 clean install"
>>
>> -Xms1024m -Xmx3076m
>> -Xms128m -Xmx4096m
>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
>> -Xmx3g -XX:-UseGCOverheadLimit
>>
>> All eventually fail in the same spot:
>>
>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 154.539
>> sec <<< FAILURE! - in TestSuite
>> testManyFilesOpened on
>> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
>>  Time elapsed: 59.672 sec  <<< FAILURE!
>> java.lang.OutOfMemoryError: GC overhead limit exceeded
>> at
>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
>> at
>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
>> at
>> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
>> at
>> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
>>
>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a 3GHz i7
>> processor and 16GB memory.
>>
>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
>>
>>> often that error is because the heap is overcommitted.... What version of
>>> the JDK are you attempting to build with, and what MAVEN_OPTS are you
>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>>>
>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
>>> wrote:
>>>
>>> > Hi Pierre,
>>> >
>>> > I'm hitting the same issues on Mac with the master branch (specifically
>>> > while it runs testManyOpenedFiles in nifi-framework-core). Been tuning
>>> Xmx,
>>> > ulimits, and G1GC to no avail. Perhaps we could continue that
>>> investigation
>>> > on a separate non-voting thread.
>>> >
>>> > Thanks,
>>> > Brian
>>> >
>>> > On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
>>> > [hidden email]>
>>> > wrote:
>>> >
>>> > > Hi all,
>>> > >
>>> > > I got some issues when building the version (on Windows):
>>> > > - with 'mvn clean install -Pcontrib-check', I got GC overhead limit
>>> error
>>> > > on unit tests in framework-core (I didn't manage to get it working by
>>> > > changing options in Maven but I guess I missed something with my own
>>> > local
>>> > > environment)
>>> > > - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
>>> > following
>>> > > error : [ERROR] Failed to execute goal
>>> > > org.apache.rat:apache-rat-plugin:0.11:check (default) on project
>>> > > nifi-standard-processors: Too many files with unapproved license: 1
>>> See
>>> > RAT
>>> > > report (It comes from
>>> > >
>>> > >
>>> >
>>> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
>>> > > - with 'mvn clean install -DskipTests', it is OK.
>>> > >
>>> > > Otherwise, as far as I looked, it seems OK to me.
>>> > >
>>> > >
>>> > >
>>> > >
>>> > > 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>>> > >
>>> > > > Hello,
>>> > > > I am pleased to be calling this vote for the source release of
>>> Apache
>>> > > NiFi
>>> > > > nifi-0.5.1.
>>> > > >
>>> > > > The source zip, including signatures, digests, etc. can be found at:
>>> > > >
>>> https://repository.apache.org/content/repositories/orgapachenifi-1075
>>> > > >
>>> > > > The Git tag is nifi-0.5.1-RC1
>>> > > > The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>> > > >
>>> > > >
>>> > >
>>> >
>>> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>> > > >
>>> > > > This release candidate is a branch off of support/nifi-0.5.x at
>>> > > > 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>>> > > >
>>> > > > Checksums of nifi-0.5.1-source-release.zip:
>>> > > > MD5: 02b920f226643412cc9ff5f7103fa156
>>> > > > SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>>> > > >
>>> > > > Release artifacts are signed with the following key:
>>> > > > https://people.apache.org/keys/committer/tkurc.asc
>>> > > >
>>> > > > KEYS file available here:
>>> > > > https://dist.apache.org/repos/dist/release/nifi/KEYS
>>> > > >
>>> > > > 11 issues were closed/resolved for this release:
>>> > > >
>>> > > >
>>> > >
>>> >
>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>>> > > >
>>> > > > Release note highlights can be found here:
>>> > > >
>>> > > >
>>> > >
>>> >
>>> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>>> > > >
>>> > > > The vote will be open for 72 hours.
>>> > > > Please download the release candidate and evaluate the necessary
>>> items
>>> > > > including checking hashes, signatures, build from source, and test.
>>> > Then
>>> > > > please vote:
>>> > > >
>>> > > > [ ] +1 Release this package as nifi-0.5.1
>>> > > > [ ] +0 no opinion
>>> > > > [ ] -1 Do not release this package because because...
>>> > > >
>>> > > > Thanks again for helping with this release!
>>> > > >
>>> > > > Tony
>>> > > >
>>> > >
>>> >
>>>
>>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Mark Payne
+1 (binding) Release this package as nifi-0.5.1

Verified hashes & build w/ unit tests & contrib work. Verified that the initial issue that
caused the 0.5.1 release (NIFI-1527) was addressed.

-Mark


> On Feb 23, 2016, at 12:35 PM, Joe Witt <[hidden email]> wrote:
>
> +1 (binding) Release this package as nifi-0.5.1
>
> Ran through all steps outlined for verification and validated numerous
> JIRAs on the release and confirmed the finding Sean had for the
> sources/javadocs has been resolved.
>
> Thanks!
>
> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <[hidden email]> wrote:
>> Upgrading to JDK 8 u74 works like a charm - everything builds and tests to
>> success. The fan is a lot quieter now too. Thanks for the pointer on the
>> JDK version!
>>
>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <[hidden email]>
>> wrote:
>>
>>> Thanks, Tony!
>>>
>>> Oracle JDK 8 u45 (1.8.0_45)
>>>
>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 clean
>>> install" and "mvn -T C4.0 clean install"
>>>
>>> -Xms1024m -Xmx3076m
>>> -Xms128m -Xmx4096m
>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
>>> -Xmx3g -XX:-UseGCOverheadLimit
>>>
>>> All eventually fail in the same spot:
>>>
>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 154.539
>>> sec <<< FAILURE! - in TestSuite
>>> testManyFilesOpened on
>>> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
>>> Time elapsed: 59.672 sec  <<< FAILURE!
>>> java.lang.OutOfMemoryError: GC overhead limit exceeded
>>> at
>>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
>>> at
>>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
>>> at
>>> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
>>> at
>>> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
>>>
>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a 3GHz i7
>>> processor and 16GB memory.
>>>
>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
>>>
>>>> often that error is because the heap is overcommitted.... What version of
>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are you
>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>>>>
>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
>>>> wrote:
>>>>
>>>>> Hi Pierre,
>>>>>
>>>>> I'm hitting the same issues on Mac with the master branch (specifically
>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been tuning
>>>> Xmx,
>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that
>>>> investigation
>>>>> on a separate non-voting thread.
>>>>>
>>>>> Thanks,
>>>>> Brian
>>>>>
>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
>>>>> [hidden email]>
>>>>> wrote:
>>>>>
>>>>>> Hi all,
>>>>>>
>>>>>> I got some issues when building the version (on Windows):
>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead limit
>>>> error
>>>>>> on unit tests in framework-core (I didn't manage to get it working by
>>>>>> changing options in Maven but I guess I missed something with my own
>>>>> local
>>>>>> environment)
>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
>>>>> following
>>>>>> error : [ERROR] Failed to execute goal
>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on project
>>>>>> nifi-standard-processors: Too many files with unapproved license: 1
>>>> See
>>>>> RAT
>>>>>> report (It comes from
>>>>>>
>>>>>>
>>>>>
>>>> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
>>>>>> - with 'mvn clean install -DskipTests', it is OK.
>>>>>>
>>>>>> Otherwise, as far as I looked, it seems OK to me.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>>>>>>
>>>>>>> Hello,
>>>>>>> I am pleased to be calling this vote for the source release of
>>>> Apache
>>>>>> NiFi
>>>>>>> nifi-0.5.1.
>>>>>>>
>>>>>>> The source zip, including signatures, digests, etc. can be found at:
>>>>>>>
>>>> https://repository.apache.org/content/repositories/orgapachenifi-1075
>>>>>>>
>>>>>>> The Git tag is nifi-0.5.1-RC1
>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>>>>>>
>>>>>>> This release candidate is a branch off of support/nifi-0.5.x at
>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>>>>>>>
>>>>>>> Checksums of nifi-0.5.1-source-release.zip:
>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156
>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>>>>>>>
>>>>>>> Release artifacts are signed with the following key:
>>>>>>> https://people.apache.org/keys/committer/tkurc.asc
>>>>>>>
>>>>>>> KEYS file available here:
>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS
>>>>>>>
>>>>>>> 11 issues were closed/resolved for this release:
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>>>>>>>
>>>>>>> Release note highlights can be found here:
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>>>>>>>
>>>>>>> The vote will be open for 72 hours.
>>>>>>> Please download the release candidate and evaluate the necessary
>>>> items
>>>>>>> including checking hashes, signatures, build from source, and test.
>>>>> Then
>>>>>>> please vote:
>>>>>>>
>>>>>>> [ ] +1 Release this package as nifi-0.5.1
>>>>>>> [ ] +0 no opinion
>>>>>>> [ ] -1 Do not release this package because because...
>>>>>>>
>>>>>>> Thanks again for helping with this release!
>>>>>>>
>>>>>>> Tony
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Joe Witt
-1 (binding).

I continued testing to include running on a cluster w/two-way SSL and
username/password via LDAP.  What I observed has been filed as this
JIRA https://issues.apache.org/jira/browse/NIFI-1557

The root of the issue has been identified and am now testing against a
patch that has proven to address the problem.  Continuing to evaluate
behavior around this to ensure it is fully addressed.

This issue is believed to have been present ever since we added
controller services and reporting tasks through the UI (version 0.1.0)
and has been causing confusion for folks for some time and can create
difficultly when restarting nodes or upgrading.  In my opinion this
warrants canceling 0.5.1 RC1 and instead addressing this issue and
producing an 0.5.1 RC2.

Thanks
Joe

On Tue, Feb 23, 2016 at 1:35 PM, Mark Payne <[hidden email]> wrote:

> +1 (binding) Release this package as nifi-0.5.1
>
> Verified hashes & build w/ unit tests & contrib work. Verified that the initial issue that
> caused the 0.5.1 release (NIFI-1527) was addressed.
>
> -Mark
>
>
>> On Feb 23, 2016, at 12:35 PM, Joe Witt <[hidden email]> wrote:
>>
>> +1 (binding) Release this package as nifi-0.5.1
>>
>> Ran through all steps outlined for verification and validated numerous
>> JIRAs on the release and confirmed the finding Sean had for the
>> sources/javadocs has been resolved.
>>
>> Thanks!
>>
>> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <[hidden email]> wrote:
>>> Upgrading to JDK 8 u74 works like a charm - everything builds and tests to
>>> success. The fan is a lot quieter now too. Thanks for the pointer on the
>>> JDK version!
>>>
>>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <[hidden email]>
>>> wrote:
>>>
>>>> Thanks, Tony!
>>>>
>>>> Oracle JDK 8 u45 (1.8.0_45)
>>>>
>>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 clean
>>>> install" and "mvn -T C4.0 clean install"
>>>>
>>>> -Xms1024m -Xmx3076m
>>>> -Xms128m -Xmx4096m
>>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
>>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
>>>> -Xmx3g -XX:-UseGCOverheadLimit
>>>>
>>>> All eventually fail in the same spot:
>>>>
>>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 154.539
>>>> sec <<< FAILURE! - in TestSuite
>>>> testManyFilesOpened on
>>>> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
>>>> Time elapsed: 59.672 sec  <<< FAILURE!
>>>> java.lang.OutOfMemoryError: GC overhead limit exceeded
>>>> at
>>>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
>>>> at
>>>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
>>>> at
>>>> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
>>>> at
>>>> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
>>>>
>>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a 3GHz i7
>>>> processor and 16GB memory.
>>>>
>>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
>>>>
>>>>> often that error is because the heap is overcommitted.... What version of
>>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are you
>>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>>>>>
>>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
>>>>> wrote:
>>>>>
>>>>>> Hi Pierre,
>>>>>>
>>>>>> I'm hitting the same issues on Mac with the master branch (specifically
>>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been tuning
>>>>> Xmx,
>>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that
>>>>> investigation
>>>>>> on a separate non-voting thread.
>>>>>>
>>>>>> Thanks,
>>>>>> Brian
>>>>>>
>>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
>>>>>> [hidden email]>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I got some issues when building the version (on Windows):
>>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead limit
>>>>> error
>>>>>>> on unit tests in framework-core (I didn't manage to get it working by
>>>>>>> changing options in Maven but I guess I missed something with my own
>>>>>> local
>>>>>>> environment)
>>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
>>>>>> following
>>>>>>> error : [ERROR] Failed to execute goal
>>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on project
>>>>>>> nifi-standard-processors: Too many files with unapproved license: 1
>>>>> See
>>>>>> RAT
>>>>>>> report (It comes from
>>>>>>>
>>>>>>>
>>>>>>
>>>>> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
>>>>>>> - with 'mvn clean install -DskipTests', it is OK.
>>>>>>>
>>>>>>> Otherwise, as far as I looked, it seems OK to me.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>>>>>>>
>>>>>>>> Hello,
>>>>>>>> I am pleased to be calling this vote for the source release of
>>>>> Apache
>>>>>>> NiFi
>>>>>>>> nifi-0.5.1.
>>>>>>>>
>>>>>>>> The source zip, including signatures, digests, etc. can be found at:
>>>>>>>>
>>>>> https://repository.apache.org/content/repositories/orgapachenifi-1075
>>>>>>>>
>>>>>>>> The Git tag is nifi-0.5.1-RC1
>>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>>>>>>>
>>>>>>>> This release candidate is a branch off of support/nifi-0.5.x at
>>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>>>>>>>>
>>>>>>>> Checksums of nifi-0.5.1-source-release.zip:
>>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156
>>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>>>>>>>>
>>>>>>>> Release artifacts are signed with the following key:
>>>>>>>> https://people.apache.org/keys/committer/tkurc.asc
>>>>>>>>
>>>>>>>> KEYS file available here:
>>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS
>>>>>>>>
>>>>>>>> 11 issues were closed/resolved for this release:
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>>>>>>>>
>>>>>>>> Release note highlights can be found here:
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>>>>>>>>
>>>>>>>> The vote will be open for 72 hours.
>>>>>>>> Please download the release candidate and evaluate the necessary
>>>>> items
>>>>>>>> including checking hashes, signatures, build from source, and test.
>>>>>> Then
>>>>>>>> please vote:
>>>>>>>>
>>>>>>>> [ ] +1 Release this package as nifi-0.5.1
>>>>>>>> [ ] +0 no opinion
>>>>>>>> [ ] -1 Do not release this package because because...
>>>>>>>>
>>>>>>>> Thanks again for helping with this release!
>>>>>>>>
>>>>>>>> Tony
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Mark Payne
Agreed - I would recommend holding off the 0.5.1 release for this - it can be very
frustrating when this occurs. Will change my vote also to -1.


> On Feb 23, 2016, at 4:11 PM, Joe Witt <[hidden email]> wrote:
>
> -1 (binding).
>
> I continued testing to include running on a cluster w/two-way SSL and
> username/password via LDAP.  What I observed has been filed as this
> JIRA https://issues.apache.org/jira/browse/NIFI-1557
>
> The root of the issue has been identified and am now testing against a
> patch that has proven to address the problem.  Continuing to evaluate
> behavior around this to ensure it is fully addressed.
>
> This issue is believed to have been present ever since we added
> controller services and reporting tasks through the UI (version 0.1.0)
> and has been causing confusion for folks for some time and can create
> difficultly when restarting nodes or upgrading.  In my opinion this
> warrants canceling 0.5.1 RC1 and instead addressing this issue and
> producing an 0.5.1 RC2.
>
> Thanks
> Joe
>
> On Tue, Feb 23, 2016 at 1:35 PM, Mark Payne <[hidden email]> wrote:
>> +1 (binding) Release this package as nifi-0.5.1
>>
>> Verified hashes & build w/ unit tests & contrib work. Verified that the initial issue that
>> caused the 0.5.1 release (NIFI-1527) was addressed.
>>
>> -Mark
>>
>>
>>> On Feb 23, 2016, at 12:35 PM, Joe Witt <[hidden email]> wrote:
>>>
>>> +1 (binding) Release this package as nifi-0.5.1
>>>
>>> Ran through all steps outlined for verification and validated numerous
>>> JIRAs on the release and confirmed the finding Sean had for the
>>> sources/javadocs has been resolved.
>>>
>>> Thanks!
>>>
>>> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <[hidden email]> wrote:
>>>> Upgrading to JDK 8 u74 works like a charm - everything builds and tests to
>>>> success. The fan is a lot quieter now too. Thanks for the pointer on the
>>>> JDK version!
>>>>
>>>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <[hidden email]>
>>>> wrote:
>>>>
>>>>> Thanks, Tony!
>>>>>
>>>>> Oracle JDK 8 u45 (1.8.0_45)
>>>>>
>>>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 clean
>>>>> install" and "mvn -T C4.0 clean install"
>>>>>
>>>>> -Xms1024m -Xmx3076m
>>>>> -Xms128m -Xmx4096m
>>>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
>>>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
>>>>> -Xmx3g -XX:-UseGCOverheadLimit
>>>>>
>>>>> All eventually fail in the same spot:
>>>>>
>>>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 154.539
>>>>> sec <<< FAILURE! - in TestSuite
>>>>> testManyFilesOpened on
>>>>> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
>>>>> Time elapsed: 59.672 sec  <<< FAILURE!
>>>>> java.lang.OutOfMemoryError: GC overhead limit exceeded
>>>>> at
>>>>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
>>>>> at
>>>>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
>>>>> at
>>>>> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
>>>>> at
>>>>> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
>>>>>
>>>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a 3GHz i7
>>>>> processor and 16GB memory.
>>>>>
>>>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
>>>>>
>>>>>> often that error is because the heap is overcommitted.... What version of
>>>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are you
>>>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>>>>>>
>>>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <[hidden email]>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Pierre,
>>>>>>>
>>>>>>> I'm hitting the same issues on Mac with the master branch (specifically
>>>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been tuning
>>>>>> Xmx,
>>>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that
>>>>>> investigation
>>>>>>> on a separate non-voting thread.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Brian
>>>>>>>
>>>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
>>>>>>> [hidden email]>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> I got some issues when building the version (on Windows):
>>>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead limit
>>>>>> error
>>>>>>>> on unit tests in framework-core (I didn't manage to get it working by
>>>>>>>> changing options in Maven but I guess I missed something with my own
>>>>>>> local
>>>>>>>> environment)
>>>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
>>>>>>> following
>>>>>>>> error : [ERROR] Failed to execute goal
>>>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on project
>>>>>>>> nifi-standard-processors: Too many files with unapproved license: 1
>>>>>> See
>>>>>>> RAT
>>>>>>>> report (It comes from
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
>>>>>>>> - with 'mvn clean install -DskipTests', it is OK.
>>>>>>>>
>>>>>>>> Otherwise, as far as I looked, it seems OK to me.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>> I am pleased to be calling this vote for the source release of
>>>>>> Apache
>>>>>>>> NiFi
>>>>>>>>> nifi-0.5.1.
>>>>>>>>>
>>>>>>>>> The source zip, including signatures, digests, etc. can be found at:
>>>>>>>>>
>>>>>> https://repository.apache.org/content/repositories/orgapachenifi-1075
>>>>>>>>>
>>>>>>>>> The Git tag is nifi-0.5.1-RC1
>>>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>>>>>>>>>
>>>>>>>>> This release candidate is a branch off of support/nifi-0.5.x at
>>>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>>>>>>>>>
>>>>>>>>> Checksums of nifi-0.5.1-source-release.zip:
>>>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156
>>>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>>>>>>>>>
>>>>>>>>> Release artifacts are signed with the following key:
>>>>>>>>> https://people.apache.org/keys/committer/tkurc.asc
>>>>>>>>>
>>>>>>>>> KEYS file available here:
>>>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS
>>>>>>>>>
>>>>>>>>> 11 issues were closed/resolved for this release:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>>>>>>>>>
>>>>>>>>> Release note highlights can be found here:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>>>>>>>>>
>>>>>>>>> The vote will be open for 72 hours.
>>>>>>>>> Please download the release candidate and evaluate the necessary
>>>>>> items
>>>>>>>>> including checking hashes, signatures, build from source, and test.
>>>>>>> Then
>>>>>>>>> please vote:
>>>>>>>>>
>>>>>>>>> [ ] +1 Release this package as nifi-0.5.1
>>>>>>>>> [ ] +0 no opinion
>>>>>>>>> [ ] -1 Do not release this package because because...
>>>>>>>>>
>>>>>>>>> Thanks again for helping with this release!
>>>>>>>>>
>>>>>>>>> Tony
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

trkurc
Administrator
I believe that is enough of the pmc to cancel this vote, so I will do so
On Feb 23, 2016 4:28 PM, "Mark Payne" <[hidden email]> wrote:

> Agreed - I would recommend holding off the 0.5.1 release for this - it can
> be very
> frustrating when this occurs. Will change my vote also to -1.
>
>
> > On Feb 23, 2016, at 4:11 PM, Joe Witt <[hidden email]> wrote:
> >
> > -1 (binding).
> >
> > I continued testing to include running on a cluster w/two-way SSL and
> > username/password via LDAP.  What I observed has been filed as this
> > JIRA https://issues.apache.org/jira/browse/NIFI-1557
> >
> > The root of the issue has been identified and am now testing against a
> > patch that has proven to address the problem.  Continuing to evaluate
> > behavior around this to ensure it is fully addressed.
> >
> > This issue is believed to have been present ever since we added
> > controller services and reporting tasks through the UI (version 0.1.0)
> > and has been causing confusion for folks for some time and can create
> > difficultly when restarting nodes or upgrading.  In my opinion this
> > warrants canceling 0.5.1 RC1 and instead addressing this issue and
> > producing an 0.5.1 RC2.
> >
> > Thanks
> > Joe
> >
> > On Tue, Feb 23, 2016 at 1:35 PM, Mark Payne <[hidden email]>
> wrote:
> >> +1 (binding) Release this package as nifi-0.5.1
> >>
> >> Verified hashes & build w/ unit tests & contrib work. Verified that the
> initial issue that
> >> caused the 0.5.1 release (NIFI-1527) was addressed.
> >>
> >> -Mark
> >>
> >>
> >>> On Feb 23, 2016, at 12:35 PM, Joe Witt <[hidden email]> wrote:
> >>>
> >>> +1 (binding) Release this package as nifi-0.5.1
> >>>
> >>> Ran through all steps outlined for verification and validated numerous
> >>> JIRAs on the release and confirmed the finding Sean had for the
> >>> sources/javadocs has been resolved.
> >>>
> >>> Thanks!
> >>>
> >>> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <
> [hidden email]> wrote:
> >>>> Upgrading to JDK 8 u74 works like a charm - everything builds and
> tests to
> >>>> success. The fan is a lot quieter now too. Thanks for the pointer on
> the
> >>>> JDK version!
> >>>>
> >>>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <
> [hidden email]>
> >>>> wrote:
> >>>>
> >>>>> Thanks, Tony!
> >>>>>
> >>>>> Oracle JDK 8 u45 (1.8.0_45)
> >>>>>
> >>>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0
> clean
> >>>>> install" and "mvn -T C4.0 clean install"
> >>>>>
> >>>>> -Xms1024m -Xmx3076m
> >>>>> -Xms128m -Xmx4096m
> >>>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
> >>>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
> >>>>> -Xmx3g -XX:-UseGCOverheadLimit
> >>>>>
> >>>>> All eventually fail in the same spot:
> >>>>>
> >>>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed:
> 154.539
> >>>>> sec <<< FAILURE! - in TestSuite
> >>>>> testManyFilesOpened on
> >>>>>
> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
> >>>>> Time elapsed: 59.672 sec  <<< FAILURE!
> >>>>> java.lang.OutOfMemoryError: GC overhead limit exceeded
> >>>>> at
> >>>>>
> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
> >>>>> at
> >>>>>
> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
> >>>>> at
> >>>>>
> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
> >>>>> at
> >>>>>
> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
> >>>>>
> >>>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a
> 3GHz i7
> >>>>> processor and 16GB memory.
> >>>>>
> >>>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
> >>>>>
> >>>>>> often that error is because the heap is overcommitted.... What
> version of
> >>>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are
> you
> >>>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
> >>>>>>
> >>>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <
> [hidden email]>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Hi Pierre,
> >>>>>>>
> >>>>>>> I'm hitting the same issues on Mac with the master branch
> (specifically
> >>>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been
> tuning
> >>>>>> Xmx,
> >>>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that
> >>>>>> investigation
> >>>>>>> on a separate non-voting thread.
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> Brian
> >>>>>>>
> >>>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
> >>>>>>> [hidden email]>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> Hi all,
> >>>>>>>>
> >>>>>>>> I got some issues when building the version (on Windows):
> >>>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead
> limit
> >>>>>> error
> >>>>>>>> on unit tests in framework-core (I didn't manage to get it
> working by
> >>>>>>>> changing options in Maven but I guess I missed something with my
> own
> >>>>>>> local
> >>>>>>>> environment)
> >>>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
> >>>>>>> following
> >>>>>>>> error : [ERROR] Failed to execute goal
> >>>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on project
> >>>>>>>> nifi-standard-processors: Too many files with unapproved license:
> 1
> >>>>>> See
> >>>>>>> RAT
> >>>>>>>> report (It comes from
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
> >>>>>>>> - with 'mvn clean install -DskipTests', it is OK.
> >>>>>>>>
> >>>>>>>> Otherwise, as far as I looked, it seems OK to me.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
> >>>>>>>>
> >>>>>>>>> Hello,
> >>>>>>>>> I am pleased to be calling this vote for the source release of
> >>>>>> Apache
> >>>>>>>> NiFi
> >>>>>>>>> nifi-0.5.1.
> >>>>>>>>>
> >>>>>>>>> The source zip, including signatures, digests, etc. can be found
> at:
> >>>>>>>>>
> >>>>>>
> https://repository.apache.org/content/repositories/orgapachenifi-1075
> >>>>>>>>>
> >>>>>>>>> The Git tag is nifi-0.5.1-RC1
> >>>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> >>>>>>>>>
> >>>>>>>>> This release candidate is a branch off of support/nifi-0.5.x at
> >>>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
> >>>>>>>>>
> >>>>>>>>> Checksums of nifi-0.5.1-source-release.zip:
> >>>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156
> >>>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
> >>>>>>>>>
> >>>>>>>>> Release artifacts are signed with the following key:
> >>>>>>>>> https://people.apache.org/keys/committer/tkurc.asc
> >>>>>>>>>
> >>>>>>>>> KEYS file available here:
> >>>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS
> >>>>>>>>>
> >>>>>>>>> 11 issues were closed/resolved for this release:
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
> >>>>>>>>>
> >>>>>>>>> Release note highlights can be found here:
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
> >>>>>>>>>
> >>>>>>>>> The vote will be open for 72 hours.
> >>>>>>>>> Please download the release candidate and evaluate the necessary
> >>>>>> items
> >>>>>>>>> including checking hashes, signatures, build from source, and
> test.
> >>>>>>> Then
> >>>>>>>>> please vote:
> >>>>>>>>>
> >>>>>>>>> [ ] +1 Release this package as nifi-0.5.1
> >>>>>>>>> [ ] +0 no opinion
> >>>>>>>>> [ ] -1 Do not release this package because because...
> >>>>>>>>>
> >>>>>>>>> Thanks again for helping with this release!
> >>>>>>>>>
> >>>>>>>>> Tony
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

Joe Witt
On the plus side the patch is running on a cluster and working really
well.  The issue was really obvious once we dug in.

https://issues.apache.org/jira/browse/NIFI-1557

Thanks
Joe

On Tue, Feb 23, 2016 at 4:36 PM, Tony Kurc <[hidden email]> wrote:

> I believe that is enough of the pmc to cancel this vote, so I will do so
> On Feb 23, 2016 4:28 PM, "Mark Payne" <[hidden email]> wrote:
>
>> Agreed - I would recommend holding off the 0.5.1 release for this - it can
>> be very
>> frustrating when this occurs. Will change my vote also to -1.
>>
>>
>> > On Feb 23, 2016, at 4:11 PM, Joe Witt <[hidden email]> wrote:
>> >
>> > -1 (binding).
>> >
>> > I continued testing to include running on a cluster w/two-way SSL and
>> > username/password via LDAP.  What I observed has been filed as this
>> > JIRA https://issues.apache.org/jira/browse/NIFI-1557
>> >
>> > The root of the issue has been identified and am now testing against a
>> > patch that has proven to address the problem.  Continuing to evaluate
>> > behavior around this to ensure it is fully addressed.
>> >
>> > This issue is believed to have been present ever since we added
>> > controller services and reporting tasks through the UI (version 0.1.0)
>> > and has been causing confusion for folks for some time and can create
>> > difficultly when restarting nodes or upgrading.  In my opinion this
>> > warrants canceling 0.5.1 RC1 and instead addressing this issue and
>> > producing an 0.5.1 RC2.
>> >
>> > Thanks
>> > Joe
>> >
>> > On Tue, Feb 23, 2016 at 1:35 PM, Mark Payne <[hidden email]>
>> wrote:
>> >> +1 (binding) Release this package as nifi-0.5.1
>> >>
>> >> Verified hashes & build w/ unit tests & contrib work. Verified that the
>> initial issue that
>> >> caused the 0.5.1 release (NIFI-1527) was addressed.
>> >>
>> >> -Mark
>> >>
>> >>
>> >>> On Feb 23, 2016, at 12:35 PM, Joe Witt <[hidden email]> wrote:
>> >>>
>> >>> +1 (binding) Release this package as nifi-0.5.1
>> >>>
>> >>> Ran through all steps outlined for verification and validated numerous
>> >>> JIRAs on the release and confirmed the finding Sean had for the
>> >>> sources/javadocs has been resolved.
>> >>>
>> >>> Thanks!
>> >>>
>> >>> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <
>> [hidden email]> wrote:
>> >>>> Upgrading to JDK 8 u74 works like a charm - everything builds and
>> tests to
>> >>>> success. The fan is a lot quieter now too. Thanks for the pointer on
>> the
>> >>>> JDK version!
>> >>>>
>> >>>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <
>> [hidden email]>
>> >>>> wrote:
>> >>>>
>> >>>>> Thanks, Tony!
>> >>>>>
>> >>>>> Oracle JDK 8 u45 (1.8.0_45)
>> >>>>>
>> >>>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0
>> clean
>> >>>>> install" and "mvn -T C4.0 clean install"
>> >>>>>
>> >>>>> -Xms1024m -Xmx3076m
>> >>>>> -Xms128m -Xmx4096m
>> >>>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
>> >>>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
>> >>>>> -Xmx3g -XX:-UseGCOverheadLimit
>> >>>>>
>> >>>>> All eventually fail in the same spot:
>> >>>>>
>> >>>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed:
>> 154.539
>> >>>>> sec <<< FAILURE! - in TestSuite
>> >>>>> testManyFilesOpened on
>> >>>>>
>> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
>> >>>>> Time elapsed: 59.672 sec  <<< FAILURE!
>> >>>>> java.lang.OutOfMemoryError: GC overhead limit exceeded
>> >>>>> at
>> >>>>>
>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
>> >>>>> at
>> >>>>>
>> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
>> >>>>> at
>> >>>>>
>> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
>> >>>>> at
>> >>>>>
>> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
>> >>>>>
>> >>>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a
>> 3GHz i7
>> >>>>> processor and 16GB memory.
>> >>>>>
>> >>>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]> wrote:
>> >>>>>
>> >>>>>> often that error is because the heap is overcommitted.... What
>> version of
>> >>>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are
>> you
>> >>>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m".
>> >>>>>>
>> >>>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <
>> [hidden email]>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> Hi Pierre,
>> >>>>>>>
>> >>>>>>> I'm hitting the same issues on Mac with the master branch
>> (specifically
>> >>>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been
>> tuning
>> >>>>>> Xmx,
>> >>>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that
>> >>>>>> investigation
>> >>>>>>> on a separate non-voting thread.
>> >>>>>>>
>> >>>>>>> Thanks,
>> >>>>>>> Brian
>> >>>>>>>
>> >>>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
>> >>>>>>> [hidden email]>
>> >>>>>>> wrote:
>> >>>>>>>
>> >>>>>>>> Hi all,
>> >>>>>>>>
>> >>>>>>>> I got some issues when building the version (on Windows):
>> >>>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead
>> limit
>> >>>>>> error
>> >>>>>>>> on unit tests in framework-core (I didn't manage to get it
>> working by
>> >>>>>>>> changing options in Maven but I guess I missed something with my
>> own
>> >>>>>>> local
>> >>>>>>>> environment)
>> >>>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the
>> >>>>>>> following
>> >>>>>>>> error : [ERROR] Failed to execute goal
>> >>>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on project
>> >>>>>>>> nifi-standard-processors: Too many files with unapproved license:
>> 1
>> >>>>>> See
>> >>>>>>> RAT
>> >>>>>>>> report (It comes from
>> >>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
>> >>>>>>>> - with 'mvn clean install -DskipTests', it is OK.
>> >>>>>>>>
>> >>>>>>>> Otherwise, as far as I looked, it seems OK to me.
>> >>>>>>>>
>> >>>>>>>>
>> >>>>>>>>
>> >>>>>>>>
>> >>>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
>> >>>>>>>>
>> >>>>>>>>> Hello,
>> >>>>>>>>> I am pleased to be calling this vote for the source release of
>> >>>>>> Apache
>> >>>>>>>> NiFi
>> >>>>>>>>> nifi-0.5.1.
>> >>>>>>>>>
>> >>>>>>>>> The source zip, including signatures, digests, etc. can be found
>> at:
>> >>>>>>>>>
>> >>>>>>
>> https://repository.apache.org/content/repositories/orgapachenifi-1075
>> >>>>>>>>>
>> >>>>>>>>> The Git tag is nifi-0.5.1-RC1
>> >>>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>> >>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
>> >>>>>>>>>
>> >>>>>>>>> This release candidate is a branch off of support/nifi-0.5.x at
>> >>>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
>> >>>>>>>>>
>> >>>>>>>>> Checksums of nifi-0.5.1-source-release.zip:
>> >>>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156
>> >>>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
>> >>>>>>>>>
>> >>>>>>>>> Release artifacts are signed with the following key:
>> >>>>>>>>> https://people.apache.org/keys/committer/tkurc.asc
>> >>>>>>>>>
>> >>>>>>>>> KEYS file available here:
>> >>>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS
>> >>>>>>>>>
>> >>>>>>>>> 11 issues were closed/resolved for this release:
>> >>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
>> >>>>>>>>>
>> >>>>>>>>> Release note highlights can be found here:
>> >>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
>> >>>>>>>>>
>> >>>>>>>>> The vote will be open for 72 hours.
>> >>>>>>>>> Please download the release candidate and evaluate the necessary
>> >>>>>> items
>> >>>>>>>>> including checking hashes, signatures, build from source, and
>> test.
>> >>>>>>> Then
>> >>>>>>>>> please vote:
>> >>>>>>>>>
>> >>>>>>>>> [ ] +1 Release this package as nifi-0.5.1
>> >>>>>>>>> [ ] +0 no opinion
>> >>>>>>>>> [ ] -1 Do not release this package because because...
>> >>>>>>>>>
>> >>>>>>>>> Thanks again for helping with this release!
>> >>>>>>>>>
>> >>>>>>>>> Tony
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>
>> >>>>>
>> >>
>>
>>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache NiFi 0.5.1 (RC1)

trkurc
Administrator
While I start working on putting together RC2, please consider checking out
e2005fa059fbe128e2e278cda5ed7a27ab6e1ec3, which is where I intend to branch
from.

On Tue, Feb 23, 2016 at 4:37 PM, Joe Witt <[hidden email]> wrote:

> On the plus side the patch is running on a cluster and working really
> well.  The issue was really obvious once we dug in.
>
> https://issues.apache.org/jira/browse/NIFI-1557
>
> Thanks
> Joe
>
> On Tue, Feb 23, 2016 at 4:36 PM, Tony Kurc <[hidden email]> wrote:
> > I believe that is enough of the pmc to cancel this vote, so I will do so
> > On Feb 23, 2016 4:28 PM, "Mark Payne" <[hidden email]> wrote:
> >
> >> Agreed - I would recommend holding off the 0.5.1 release for this - it
> can
> >> be very
> >> frustrating when this occurs. Will change my vote also to -1.
> >>
> >>
> >> > On Feb 23, 2016, at 4:11 PM, Joe Witt <[hidden email]> wrote:
> >> >
> >> > -1 (binding).
> >> >
> >> > I continued testing to include running on a cluster w/two-way SSL and
> >> > username/password via LDAP.  What I observed has been filed as this
> >> > JIRA https://issues.apache.org/jira/browse/NIFI-1557
> >> >
> >> > The root of the issue has been identified and am now testing against a
> >> > patch that has proven to address the problem.  Continuing to evaluate
> >> > behavior around this to ensure it is fully addressed.
> >> >
> >> > This issue is believed to have been present ever since we added
> >> > controller services and reporting tasks through the UI (version 0.1.0)
> >> > and has been causing confusion for folks for some time and can create
> >> > difficultly when restarting nodes or upgrading.  In my opinion this
> >> > warrants canceling 0.5.1 RC1 and instead addressing this issue and
> >> > producing an 0.5.1 RC2.
> >> >
> >> > Thanks
> >> > Joe
> >> >
> >> > On Tue, Feb 23, 2016 at 1:35 PM, Mark Payne <[hidden email]>
> >> wrote:
> >> >> +1 (binding) Release this package as nifi-0.5.1
> >> >>
> >> >> Verified hashes & build w/ unit tests & contrib work. Verified that
> the
> >> initial issue that
> >> >> caused the 0.5.1 release (NIFI-1527) was addressed.
> >> >>
> >> >> -Mark
> >> >>
> >> >>
> >> >>> On Feb 23, 2016, at 12:35 PM, Joe Witt <[hidden email]> wrote:
> >> >>>
> >> >>> +1 (binding) Release this package as nifi-0.5.1
> >> >>>
> >> >>> Ran through all steps outlined for verification and validated
> numerous
> >> >>> JIRAs on the release and confirmed the finding Sean had for the
> >> >>> sources/javadocs has been resolved.
> >> >>>
> >> >>> Thanks!
> >> >>>
> >> >>> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli <
> >> [hidden email]> wrote:
> >> >>>> Upgrading to JDK 8 u74 works like a charm - everything builds and
> >> tests to
> >> >>>> success. The fan is a lot quieter now too. Thanks for the pointer
> on
> >> the
> >> >>>> JDK version!
> >> >>>>
> >> >>>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli <
> >> [hidden email]>
> >> >>>> wrote:
> >> >>>>
> >> >>>>> Thanks, Tony!
> >> >>>>>
> >> >>>>> Oracle JDK 8 u45 (1.8.0_45)
> >> >>>>>
> >> >>>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T
> C2.0
> >> clean
> >> >>>>> install" and "mvn -T C4.0 clean install"
> >> >>>>>
> >> >>>>> -Xms1024m -Xmx3076m
> >> >>>>> -Xms128m -Xmx4096m
> >> >>>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication
> >> >>>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC
> >> >>>>> -Xmx3g -XX:-UseGCOverheadLimit
> >> >>>>>
> >> >>>>> All eventually fail in the same spot:
> >> >>>>>
> >> >>>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed:
> >> 154.539
> >> >>>>> sec <<< FAILURE! - in TestSuite
> >> >>>>> testManyFilesOpened on
> >> >>>>>
> >>
> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession)
> >> >>>>> Time elapsed: 59.672 sec  <<< FAILURE!
> >> >>>>> java.lang.OutOfMemoryError: GC overhead limit exceeded
> >> >>>>> at
> >> >>>>>
> >>
> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61)
> >> >>>>> at
> >> >>>>>
> >>
> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46)
> >> >>>>> at
> >> >>>>>
> >>
> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009)
> >> >>>>> at
> >> >>>>>
> >>
> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775)
> >> >>>>>
> >> >>>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a
> >> 3GHz i7
> >> >>>>> processor and 16GB memory.
> >> >>>>>
> >> >>>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[hidden email]>
> wrote:
> >> >>>>>
> >> >>>>>> often that error is because the heap is overcommitted.... What
> >> version of
> >> >>>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are
> >> you
> >> >>>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m
> -Xmx3076m".
> >> >>>>>>
> >> >>>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli <
> >> [hidden email]>
> >> >>>>>> wrote:
> >> >>>>>>
> >> >>>>>>> Hi Pierre,
> >> >>>>>>>
> >> >>>>>>> I'm hitting the same issues on Mac with the master branch
> >> (specifically
> >> >>>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been
> >> tuning
> >> >>>>>> Xmx,
> >> >>>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that
> >> >>>>>> investigation
> >> >>>>>>> on a separate non-voting thread.
> >> >>>>>>>
> >> >>>>>>> Thanks,
> >> >>>>>>> Brian
> >> >>>>>>>
> >> >>>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard <
> >> >>>>>>> [hidden email]>
> >> >>>>>>> wrote:
> >> >>>>>>>
> >> >>>>>>>> Hi all,
> >> >>>>>>>>
> >> >>>>>>>> I got some issues when building the version (on Windows):
> >> >>>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead
> >> limit
> >> >>>>>> error
> >> >>>>>>>> on unit tests in framework-core (I didn't manage to get it
> >> working by
> >> >>>>>>>> changing options in Maven but I guess I missed something with
> my
> >> own
> >> >>>>>>> local
> >> >>>>>>>> environment)
> >> >>>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got
> the
> >> >>>>>>> following
> >> >>>>>>>> error : [ERROR] Failed to execute goal
> >> >>>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on
> project
> >> >>>>>>>> nifi-standard-processors: Too many files with unapproved
> license:
> >> 1
> >> >>>>>> See
> >> >>>>>>> RAT
> >> >>>>>>>> report (It comes from
> >> >>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>
> >> >>>>>>
> >>
> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc)
> >> >>>>>>>> - with 'mvn clean install -DskipTests', it is OK.
> >> >>>>>>>>
> >> >>>>>>>> Otherwise, as far as I looked, it seems OK to me.
> >> >>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[hidden email]>:
> >> >>>>>>>>
> >> >>>>>>>>> Hello,
> >> >>>>>>>>> I am pleased to be calling this vote for the source release of
> >> >>>>>> Apache
> >> >>>>>>>> NiFi
> >> >>>>>>>>> nifi-0.5.1.
> >> >>>>>>>>>
> >> >>>>>>>>> The source zip, including signatures, digests, etc. can be
> found
> >> at:
> >> >>>>>>>>>
> >> >>>>>>
> >> https://repository.apache.org/content/repositories/orgapachenifi-1075
> >> >>>>>>>>>
> >> >>>>>>>>> The Git tag is nifi-0.5.1-RC1
> >> >>>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> >> >>>>>>>>>
> >> >>>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>
> >> >>>>>>
> >>
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63
> >> >>>>>>>>>
> >> >>>>>>>>> This release candidate is a branch off of support/nifi-0.5.x
> at
> >> >>>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1.
> >> >>>>>>>>>
> >> >>>>>>>>> Checksums of nifi-0.5.1-source-release.zip:
> >> >>>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156
> >> >>>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce
> >> >>>>>>>>>
> >> >>>>>>>>> Release artifacts are signed with the following key:
> >> >>>>>>>>> https://people.apache.org/keys/committer/tkurc.asc
> >> >>>>>>>>>
> >> >>>>>>>>> KEYS file available here:
> >> >>>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS
> >> >>>>>>>>>
> >> >>>>>>>>> 11 issues were closed/resolved for this release:
> >> >>>>>>>>>
> >> >>>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>
> >> >>>>>>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887
> >> >>>>>>>>>
> >> >>>>>>>>> Release note highlights can be found here:
> >> >>>>>>>>>
> >> >>>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>
> >> >>>>>>
> >>
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1
> >> >>>>>>>>>
> >> >>>>>>>>> The vote will be open for 72 hours.
> >> >>>>>>>>> Please download the release candidate and evaluate the
> necessary
> >> >>>>>> items
> >> >>>>>>>>> including checking hashes, signatures, build from source, and
> >> test.
> >> >>>>>>> Then
> >> >>>>>>>>> please vote:
> >> >>>>>>>>>
> >> >>>>>>>>> [ ] +1 Release this package as nifi-0.5.1
> >> >>>>>>>>> [ ] +0 no opinion
> >> >>>>>>>>> [ ] -1 Do not release this package because because...
> >> >>>>>>>>>
> >> >>>>>>>>> Thanks again for helping with this release!
> >> >>>>>>>>>
> >> >>>>>>>>> Tony
> >> >>>>>>>>>
> >> >>>>>>>>
> >> >>>>>>>
> >> >>>>>>
> >> >>>>>
> >> >>
> >>
> >>
>