full clean build under 3 mins!

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

full clean build under 3 mins!

Joe Witt
I want to thank everyone who alerted that the build process was in need of
serious improvement and who provided suggestions and contribs on how to do
so.

NIFI-169 was the first major pass at this and it was to move to a single
maven build structure.  We unfortunately fell slightly short of a single
command because Maven will not allow you to build plugins with extension
support required in the event that the same plugin will be used in the same
reactor build.  So it is two parts.  And we could probably get it down to
one with a little trickeration eventually.

But in any event with the nar plugin built already and everything else
already cleaned the build can now be done in as little as 3 minutes!!!

[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 02:52 min (Wall Clock)
[INFO] Finished at: 2014-12-16T23:20:02-05:00
[INFO] Final Memory: 141M/478M
[INFO]
------------------------------------------------------------------------

That is in comparison to the 20-30 minutes it was before.

Awesome!

Thanks
Joe
Reply | Threaded
Open this post in threaded view
|

Re: full clean build under 3 mins!

Joe Witt
In fairness i cheated slightly by skipping tests.  But by not skipping them
it takes just under 5 minutes.  Still massively better.

And now we can utilize maven's parallel build feature by running something
like:

mvn -T 2.0C install

On Tue, Dec 16, 2014 at 11:27 PM, Joe Witt <[hidden email]> wrote:

>
> I want to thank everyone who alerted that the build process was in need of
> serious improvement and who provided suggestions and contribs on how to do
> so.
>
> NIFI-169 was the first major pass at this and it was to move to a single
> maven build structure.  We unfortunately fell slightly short of a single
> command because Maven will not allow you to build plugins with extension
> support required in the event that the same plugin will be used in the same
> reactor build.  So it is two parts.  And we could probably get it down to
> one with a little trickeration eventually.
>
> But in any event with the nar plugin built already and everything else
> already cleaned the build can now be done in as little as 3 minutes!!!
>
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 02:52 min (Wall Clock)
> [INFO] Finished at: 2014-12-16T23:20:02-05:00
> [INFO] Final Memory: 141M/478M
> [INFO]
> ------------------------------------------------------------------------
>
> That is in comparison to the 20-30 minutes it was before.
>
> Awesome!
>
> Thanks
> Joe
>