NIFI-3530 - org.apache.thrift.transport.TTransportException: Invalid status -128

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

NIFI-3530 - org.apache.thrift.transport.TTransportException: Invalid status -128

Forest Lin
Hi all,


Was https://issues.apache.org/jira/browse/NIFI-3530 fixed in the just-released nifi v1.2?
In my PutHiveStreaming
Hive Metastore URI   = thrift://en1-dev1-tbdp.local.alipay.net:9083
Hive Configuration Resources = /usr/hdp/2.4.3.0-227/etc/hive/conf.dist/hive-site.xml
Database Name = poc
Table Name = table1
Kerberos Principal=nifi/[hidden email]
Kerberos Keytab=/home/nifi/nifi.keytab


when running the PutHiveStreaming,  it shows
2017-05-13 00:28:11,321 INFO [put-hive-streaming-0] hive.metastore Trying to connect to metastore with URI thrift://en1-dev1-tbdp.local.alipay.net:9083
2017-05-13 00:28:53,666 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@578483bd checkpointed with 0 Records and 0 Swap Files in 14 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 1 millis), max Transaction ID -1
2017-05-13 00:28:54,427 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository
2017-05-13 00:28:54,486 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@4c617143 checkpointed with 2 Records and 0 Swap Files in 58 milliseconds (Stop-the-world time = 26 milliseconds, Clear Edit Logs time = 16 millis), max Transaction ID 4
2017-05-13 00:28:54,486 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 2 records in 58 milliseconds
2017-05-13 00:30:53,673 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@578483bd checkpointed with 0 Records and 0 Swap Files in 5 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1
2017-05-13 00:30:54,486 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository
2017-05-13 00:30:54,542 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@4c617143 checkpointed with 2 Records and 0 Swap Files in 55 milliseconds (Stop-the-world time = 24 milliseconds, Clear Edit Logs time = 15 millis), max Transaction ID 4
2017-05-13 00:30:54,542 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 2 records in 55 milliseconds


In hivemetastore.log, it has below error


2017-05-13 00:28:06,798 INFO  [org.apache.hadoop.hive.ql.txn.compactor.HouseKeeperServiceBase$1-0]: txn.AcidCompactionHistoryService (AcidCompactionHistoryService.java:run(76)) - History reaper reaper ran for 0seconds.  isAliveCounter=-2147482060
2017-05-13 00:28:11,370 ERROR [pool-6-thread-200]: server.TThreadPoolServer (TThreadPoolServer.java:run(296)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more


nifi a/c is ensured to have right to access hdfs/hive before running. .


Please would anyone share me any experience on fixing this?


Thanks,
Forest