Secured NIFI (clustered) error on ListFile viewstate

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Secured NIFI (clustered) error on ListFile viewstate

Milan Das
I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean

Not sure, if there is something else need to be done.

 

Configuratons are as below:

 

conf/state-management.xml

    <cluster-provider>

        <id>zk-provider</id>

        <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>

        <property name="Connect String"></property>

        <property name="Root Node">/nifi</property>

        <property name="Session Timeout">10 seconds</property>

        <property name="Access Control">Open</property>

    </cluster-provider>

 

 

conf/bootstrap.conf

java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf

 

 

Error Message:

 

2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out

2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator

javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out

                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)

                at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)

                at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)

                at org.glassfish.jersey.internal.Errors.process(Errors.java:316)

                at org.glassfish.jersey.internal.Errors.process(Errors.java:298)

                at org.glassfish.jersey.internal.Errors.process(Errors.java:229)

                at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)

                at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)

                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)

                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)

                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

                at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

                at java.lang.Thread.run(Thread.java:748)

Caused by: java.net.SocketTimeoutException: Read timed out

                at java.net.SocketInputStream.socketRead0(Native Method)

                at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)

                at java.net.SocketInputStream.read(SocketInputStream.java:171)

                at java.net.SocketInputStream.read(SocketInputStream.java:141)

                at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)

                at sun.security.ssl.InputRecord.read(InputRecord.java:503)

                at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)

                at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)

                at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)

                at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)

                at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)

                at java.io.BufferedInputStream.read(BufferedInputStream.java:345)

                at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)

                at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)

                at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)

                at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)

                at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)

                at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)

                at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)

                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)

                ... 14 common frames omitted

Reply | Threaded
Open this post in threaded view
|

Re: Secured NIFI (clustered) error on ListFile viewstate

Milan Das
Hello Nifi team,

Wondering if it is something more I need to do.

Otherwise I am planning to log a defect in Jira

 

Thanks,

Milan

 

From: Milan Das <[hidden email]>
Date: Friday, November 2, 2018 at 10:08 AM
To: "[hidden email]" <[hidden email]>
Subject: Secured NIFI (clustered) error on ListFile viewstate

 

I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean

Not sure, if there is something else need to be done.

 

Configuratons are as below:

 

conf/state-management.xml

    <cluster-provider>

        <id>zk-provider</id>

        <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>

        <property name="Connect String"></property>

        <property name="Root Node">/nifi</property>

        <property name="Session Timeout">10 seconds</property>

        <property name="Access Control">Open</property>

    </cluster-provider>

 

 

conf/bootstrap.conf

java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf

 

 

Error Message:

 

2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out

2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator

javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out

                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)

                at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)

                at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)

                at org.glassfish.jersey.internal.Errors.process(Errors.java:316)

                at org.glassfish.jersey.internal.Errors.process(Errors.java:298)

                at org.glassfish.jersey.internal.Errors.process(Errors.java:229)

                at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)

                at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)

                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)

                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)

                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

                at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

                at java.lang.Thread.run(Thread.java:748)

Caused by: java.net.SocketTimeoutException: Read timed out

                at java.net.SocketInputStream.socketRead0(Native Method)

                at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)

                at java.net.SocketInputStream.read(SocketInputStream.java:171)

                at java.net.SocketInputStream.read(SocketInputStream.java:141)

                at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)

                at sun.security.ssl.InputRecord.read(InputRecord.java:503)

                at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)

                at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)

                at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)

                at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)

                at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)

                at java.io.BufferedInputStream.read(BufferedInputStream.java:345)

                at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)

                at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)

                at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)

                at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)

                at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)

                at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)

                at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)

                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)

                ... 14 common frames omitted

Reply | Threaded
Open this post in threaded view
|

Re: Secured NIFI (clustered) error on ListFile viewstate

Andy LoPresto-2
Hi Milan,

What version of NiFi are you using? Are you using the internal ZK instance or a standalone instance? Did this work before/without ZK JaaS?

It appears the error is on request replication to another node, and the node is not listening/responding to the request.

Andy LoPresto
[hidden email]
[hidden email]
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On Nov 9, 2018, at 2:07 AM, Milan Das <[hidden email]> wrote:
>
> Hello Nifi team,
>
> Wondering if it is something more I need to do.
>
> Otherwise I am planning to log a defect in Jira
>
>
>
> Thanks,
>
> Milan
>
>
>
> From: Milan Das <[hidden email]>
> Date: Friday, November 2, 2018 at 10:08 AM
> To: "[hidden email]" <[hidden email]>
> Subject: Secured NIFI (clustered) error on ListFile viewstate
>
>
>
> I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean
>
> Not sure, if there is something else need to be done.
>
>
>
> Configuratons are as below:
>
>
>
> conf/state-management.xml
>
>    <cluster-provider>
>
>        <id>zk-provider</id>
>
>        <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
>
>        <property name="Connect String"></property>
>
>        <property name="Root Node">/nifi</property>
>
>        <property name="Session Timeout">10 seconds</property>
>
>        <property name="Access Control">Open</property>
>
>    </cluster-provider>
>
>
>
>
>
> conf/bootstrap.conf
>
> java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf
>
>
>
>
>
> Error Message:
>
>
>
> 2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>
> 2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
>
> javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>
>                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)
>
>                at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)
>
>                at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)
>
>                at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
>
>                at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
>
>                at org.glassfish.jersey.internal.Errors.process(Errors.java:229)
>
>                at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)
>
>                at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)
>
>                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)
>
>                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)
>
>                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>
>                at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>
>                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
>                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
>                at java.lang.Thread.run(Thread.java:748)
>
> Caused by: java.net.SocketTimeoutException: Read timed out
>
>                at java.net.SocketInputStream.socketRead0(Native Method)
>
>                at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
>
>                at java.net.SocketInputStream.read(SocketInputStream.java:171)
>
>                at java.net.SocketInputStream.read(SocketInputStream.java:141)
>
>                at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
>
>                at sun.security.ssl.InputRecord.read(InputRecord.java:503)
>
>                at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
>
>                at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
>
>                at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
>
>                at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>
>                at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>
>                at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>
>                at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
>
>                at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
>
>                at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
>
>                at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
>
>                at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
>
>                at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>
>                at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)
>
>                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)
>
>                ... 14 common frames omitted
>

Reply | Threaded
Open this post in threaded view
|

Re: Secured NIFI (clustered) error on ListFile viewstate

Milan Das
Hi Andy,
Thanks for your response.
I have tested it with 1.4 , 1.6 and 1.7.1 .
It is external zookeeper .
It works when zookeeper is not secured.
Zookeeper is up and running. Otherwise NIFI cluster state will not show running.

Thanks,
Milan Das



On 11/8/18, 6:32 PM, "Andy LoPresto" <[hidden email]> wrote:

    Hi Milan,
   
    What version of NiFi are you using? Are you using the internal ZK instance or a standalone instance? Did this work before/without ZK JaaS?
   
    It appears the error is on request replication to another node, and the node is not listening/responding to the request.
   
    Andy LoPresto
    [hidden email]
    [hidden email]
    PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69
   
    > On Nov 9, 2018, at 2:07 AM, Milan Das <[hidden email]> wrote:
    >
    > Hello Nifi team,
    >
    > Wondering if it is something more I need to do.
    >
    > Otherwise I am planning to log a defect in Jira
    >
    >
    >
    > Thanks,
    >
    > Milan
    >
    >
    >
    > From: Milan Das <[hidden email]>
    > Date: Friday, November 2, 2018 at 10:08 AM
    > To: "[hidden email]" <[hidden email]>
    > Subject: Secured NIFI (clustered) error on ListFile viewstate
    >
    >
    >
    > I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean
    >
    > Not sure, if there is something else need to be done.
    >
    >
    >
    > Configuratons are as below:
    >
    >
    >
    > conf/state-management.xml
    >
    >    <cluster-provider>
    >
    >        <id>zk-provider</id>
    >
    >        <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
    >
    >        <property name="Connect String"></property>
    >
    >        <property name="Root Node">/nifi</property>
    >
    >        <property name="Session Timeout">10 seconds</property>
    >
    >        <property name="Access Control">Open</property>
    >
    >    </cluster-provider>
    >
    >
    >
    >
    >
    > conf/bootstrap.conf
    >
    > java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf
    >
    >
    >
    >
    >
    > Error Message:
    >
    >
    >
    > 2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
    >
    > 2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
    >
    > javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
    >
    >                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)
    >
    >                at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)
    >
    >                at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)
    >
    >                at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
    >
    >                at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
    >
    >                at org.glassfish.jersey.internal.Errors.process(Errors.java:229)
    >
    >                at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)
    >
    >                at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)
    >
    >                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)
    >
    >                at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)
    >
    >                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    >
    >                at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    >
    >                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    >
    >                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    >
    >                at java.lang.Thread.run(Thread.java:748)
    >
    > Caused by: java.net.SocketTimeoutException: Read timed out
    >
    >                at java.net.SocketInputStream.socketRead0(Native Method)
    >
    >                at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
    >
    >                at java.net.SocketInputStream.read(SocketInputStream.java:171)
    >
    >                at java.net.SocketInputStream.read(SocketInputStream.java:141)
    >
    >                at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
    >
    >                at sun.security.ssl.InputRecord.read(InputRecord.java:503)
    >
    >                at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
    >
    >                at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
    >
    >                at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
    >
    >                at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
    >
    >                at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
    >
    >                at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
    >
    >                at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
    >
    >                at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
    >
    >                at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
    >
    >                at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
    >
    >                at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
    >
    >                at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
    >
    >                at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)
    >
    >                at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)
    >
    >                ... 14 common frames omitted
    >
   
   


Reply | Threaded
Open this post in threaded view
|

Re: Secured NIFI (clustered) error on ListFile viewstate

Andy LoPresto-2
There was an issue with malformed replicated requests causing a timeout [1] in previous versions, and this was resolved in 1.8.0. Could you try against 1.8.0? This issue had nothing to do with ZK though, so if the only difference between working/failing is whether ZK is secured, I think the problem is there. Are you sure that your ZK configs are correct?

[1] https://github.com/apache/nifi/commit/748cf745628dab20b7e71f12b5dcfe6ed0bbf134

 
Andy LoPresto
[hidden email]
[hidden email]
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On Nov 9, 2018, at 10:35 AM, Milan Das <[hidden email]> wrote:
>
> Hi Andy,
> Thanks for your response.
> I have tested it with 1.4 , 1.6 and 1.7.1 .
> It is external zookeeper .
> It works when zookeeper is not secured.
> Zookeeper is up and running. Otherwise NIFI cluster state will not show running.
>
> Thanks,
> Milan Das
>
>
>
> On 11/8/18, 6:32 PM, "Andy LoPresto" <[hidden email]> wrote:
>
>    Hi Milan,
>
>    What version of NiFi are you using? Are you using the internal ZK instance or a standalone instance? Did this work before/without ZK JaaS?
>
>    It appears the error is on request replication to another node, and the node is not listening/responding to the request.
>
>    Andy LoPresto
>    [hidden email]
>    [hidden email]
>    PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69
>
>> On Nov 9, 2018, at 2:07 AM, Milan Das <[hidden email]> wrote:
>>
>> Hello Nifi team,
>>
>> Wondering if it is something more I need to do.
>>
>> Otherwise I am planning to log a defect in Jira
>>
>>
>>
>> Thanks,
>>
>> Milan
>>
>>
>>
>> From: Milan Das <[hidden email]>
>> Date: Friday, November 2, 2018 at 10:08 AM
>> To: "[hidden email]" <[hidden email]>
>> Subject: Secured NIFI (clustered) error on ListFile viewstate
>>
>>
>>
>> I have a (Kerberos) secured NIFI running and it is connecting to secured SASL secured zookeeper.   Zookeeper-jaas is configured in bootstrap. Cluster starts clean
>>
>> Not sure, if there is something else need to be done.
>>
>>
>>
>> Configuratons are as below:
>>
>>
>>
>> conf/state-management.xml
>>
>>   <cluster-provider>
>>
>>       <id>zk-provider</id>
>>
>>       <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
>>
>>       <property name="Connect String"></property>
>>
>>       <property name="Root Node">/nifi</property>
>>
>>       <property name="Session Timeout">10 seconds</property>
>>
>>       <property name="Access Control">Open</property>
>>
>>   </cluster-provider>
>>
>>
>>
>>
>>
>> conf/bootstrap.conf
>>
>> java.arg.16=-Djava.security.auth.login.config=./conf/zookeeper-jaas.conf
>>
>>
>>
>>
>>
>> Error Message:
>>
>>
>>
>> 2018-11-02 13:58:22,829 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Failed to replicate request GET /nifi-api/processors/cc7b96b9-0166-1000-ffff-ffff87736df4/state to hdp265-secured-i56.interset.com:9443 due to javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>>
>> 2018-11-02 13:58:22,831 WARN [Replicate Request Thread-1] o.a.n.c.c.h.r.ThreadPoolRequestReplicator
>>
>> javax.ws.rs.ProcessingException: java.net.SocketTimeoutException: Read timed out
>>
>>               at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:284)
>>
>>               at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:278)
>>
>>               at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$0(JerseyInvocation.java:753)
>>
>>               at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
>>
>>               at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
>>
>>               at org.glassfish.jersey.internal.Errors.process(Errors.java:229)
>>
>>               at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:414)
>>
>>               at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:752)
>>
>>               at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator.replicateRequest(ThreadPoolRequestReplicator.java:661)
>>
>>               at org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator$NodeHttpRequest.run(ThreadPoolRequestReplicator.java:875)
>>
>>               at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>
>>               at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>
>>               at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>>               at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>>               at java.lang.Thread.run(Thread.java:748)
>>
>> Caused by: java.net.SocketTimeoutException: Read timed out
>>
>>               at java.net.SocketInputStream.socketRead0(Native Method)
>>
>>               at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
>>
>>               at java.net.SocketInputStream.read(SocketInputStream.java:171)
>>
>>               at java.net.SocketInputStream.read(SocketInputStream.java:141)
>>
>>               at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
>>
>>               at sun.security.ssl.InputRecord.read(InputRecord.java:503)
>>
>>               at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
>>
>>               at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)
>>
>>               at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
>>
>>               at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>>
>>               at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>>
>>               at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>>
>>               at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:735)
>>
>>               at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
>>
>>               at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)
>>
>>               at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
>>
>>               at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)
>>
>>               at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)
>>
>>               at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:390)
>>
>>               at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:282)
>>
>>               ... 14 common frames omitted
>>
>
>
>
>