<p style=”box-sizing: border-box; margin-top: 0px; font-family: ‘Helvetica Neue’, Helvetica, Arial, ‘Open Sans’, ‘Lucida Grande’, sans-serif; font-size: 14.4px; line-height: 21.6px; background-color: #fbfbfb;”>Hello Guys</p>
<p style=”box-sizing: border-box; font-family: ‘Helvetica Neue’, Helvetica, Arial, ‘Open Sans’, ‘Lucida Grande’, sans-serif; font-size: 14.4px; line-height: 21.6px; background-color: #fbfbfb;”>I am following below link to learn spark</p>
<p style=”box-sizing: border-box; font-family: ‘Helvetica Neue’, Helvetica, Arial, ‘Open Sans’, ‘Lucida Grande’, sans-serif; font-size: 14.4px; line-height: 21.6px; background-color: #fbfbfb;”><strong style=”box-sizing: border-box;”>http://hortonworks.com/hadoop-tutorial/apache-spark-1-4-1-technical-preview-with-hdp/</p>
<p style=”box-sizing: border-box; font-family: ‘Helvetica Neue’, Helvetica, Arial, ‘Open Sans’, ‘Lucida Grande’, sans-serif; font-size: 14.4px; line-height: 21.6px; background-color: #fbfbfb;”>I have downloaded the tar file but i don’t know how do I copy the tarball to my HDP 2.3 Sandbox. Please help.</p>
↧
Reply To: Spark 1.4.1 Technical Preview available
↧
Reply To: Ambari fails to register
We sorted this problem. Basically we have to manually install Ambari-agent. We followed the steps explained in the following link:
http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_troubleshooting/content/_resolving_cluster_deployment_problems.html
But we also faced problem with the THP. Explained in the same page 4.9. But the resolution that is given there is not right. We are using CentOS 6.x.
# The followinglines are added because above
# commands explained at HW 4.9 to disable THP are not working.. – MKT
echo never > /sys/kernel/mm/redhat_transparent_hugepage/enabled
echo never > /sys/kernel/mm/redhat_transparent_hugepage/defrag
↧
↧
Reply To: Spark 1.4.1 Technical Preview available
you use the sandbox ? spark must be included
↧
Reply To: Spark 1.4.1 Technical Preview available
the HDP 2.3 hortonworks use spark 1.3.1
↧
Reply To: Spark 1.4.1 Technical Preview available
yes Mr JP B, Actually I was trying to upload a file to HDP which I done using the following URL http://192.168.111.128:8000/filebrowser/#/user/root/<span style=”line-height: 1.5;”>MyDirectory/</span>
After uploading the file when I am trying to use val inFile = sc.textFile(“/user/root/MyDirectory/spam.data”) getting the following error.
↧
↧
Reply To: Spark 1.4.1 Technical Preview available
sorry i can’t see your error image picture, link seem have problem in the forum,
i use IE,Chrome,Firefox, it is same result for all browser,
↧
Reply To: Sandbox 2.3 – Could not resolve org.apache.hive.hcatalog.pig.HCatLoader
I tried today on HDP 2.3 sandbox and I still face same issue. I tried both Hue (adding -useHCatalog and ENTER) and pig CLI.
↧
how can i create rest web service can access data stored in hadoop
i want to know, what are the steps of creating simple rest web service access data stored in hadoop.
Thanks
↧
Reply To: Correct steps to setup Ambari on a CentOS VM
Ok so using “localhost.localdomain” worked. But I got some new error (which I was unable to screenshot) during the installation of each component and then it hung. I will need to recreate the process again.
Thanks again for your help.
↧
↧
connection Failed message is displaying for VirtualBox 4.3 and Hortonworks_Sandb
call from sandbox.hortonworks.com to sandbox.hortonworks.com:5020 failed on connection exception : java.net.ConnectException: Connection Refused
make: [datanode] Error 255 (ignored)
at VirtualBox-4.3.12-93733-Win.exe
Hortonworks_Sandbox_2.1.ova
↧
One JDBC connection to HiveServer2 shared with multiple threads cause Exceptions
I have a main thread that opens a JDBC connection to HiveServer2, this connection object is shared by multiple threads. The thread has a prepared statement and executes a select query(not CRUD) and does some processing with the resultset.
I am trying this with Hive as I have some legacy code from the product I work on which I dont want to change and I know that this works with Oracle.
Below is the stack trace of the exception.
org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376)
at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453)
at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435)
at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.hive.service.cli.thrift.TCLIService$Client.recv_FetchResults(TCLIService.java:501)
at org.apache.hive.service.cli.thrift.TCLIService$Client.FetchResults(TCLIService.java:488)
at org.apache.hive.jdbc.HiveQueryResultSet.next(HiveQueryResultSet.java:360)
at hivetrial.RSIterator2.run(ConcurrentRSIteration2.java:60)
at java.lang.Thread.run(Unknown Source)Trying to understand if this is a limitation.
↧
Can HDP 2.3 Sandbox be used as a Local Repository?
I want to setup a local repository for Ambari Server, for it to be able to install nodes. I have gone through the instructions about how to setup a local repository, but I want to know if HDP 2.3 VM itself could be used as a local repository because it has Apache httpd server installd. If so how?
↧
Reply To: how can i create rest web service can access data stored in hadoop
Hello Marwa,
WebHDFS is a REST service for accessing files stored in HDFS. Does this help?
http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/WebHDFS.html
–Chris
↧
↧
HUE 3.8 installation on HDP 2.3 & SLES 11 OS
I am trying to install HUE 3.8.1 on HDP 2.3 cluster installed over SLES 11 by following this blog post “http://gethue.com/hadoop-hue-3-on-hdp-installation-tutorial/”
But struggling to get all the prerequisite packages, below are packages which i’m not able to install with zypper(yast): krb5-devel , mysql-devel, openssl-devel , cyrus-sasl-devel , cyrus-sasl-gssapi, sqlite-devel, libtidy , libxml2-devel , libxslt-devel, openldap-devel, python-devel , python-setuptools
are there any online repos available from where i can get these. I was successfully in installing HUE on CentOS HDP cluster using same steps.
Realy appreciate Any help and pointers on this.
Thanks,
Deepak
↧
HUE 3.8 installation on HDP 2.3 & SLES 11 OS | problem with prerequisite package
I am trying to install HUE 3.8.1 on HDP 2.3 cluster installed over SLES 11 by following this blog post “http://gethue.com/hadoop-hue-3-on-hdp-installation-tutorial/”
But struggling to get all the prerequisite packages, below are packages which i’m not able to install with zypper(yast):
krb5-devel , mysql-devel, openssl-devel , cyrus-sasl-devel , cyrus-sasl-gssapi, sqlite-devel, libtidy , libxml2-devel , libxslt-devel, openldap-devel, python-devel , python-setuptools
Are there any online repos available from where i can get these?
I was successfully in installing this on CentOS HDP cluster, but need to make it work for SLES 11.
Really appreciate any help and pointers on this.
Thanks,
Deepak
↧
Error when starting Sandbox After Install
I got the following Error below when I tried to start the Sandbox
Failed to open a session for the virtual machine Hortonworks Sandbox with HDP 2.3.
VT-x is disabled in the BIOS for both all CPU modes (VERR_VMX_MSR_ALL_VMX_DISABLED).
Result Code: E_FAIL (0x80004005)
Component: ConsoleWrap
Interface: IConsole {872da645-4a9b-1727-bee2-5585105b9eed}
↧
Ranger Install Service fails because of mysql driver
When trying to install Ranger on the Hortonworks HDP 2.3 Sandbox on a Virtualbox 5.0.4 I get the following error when testing the connection to the database:
ERROR: Unable to connect to the DB. Please check DB connection properties. java.lang.ClassNotFoundException: com.mysql.jdbc.Driver.
I did run the ambari-server setup command and that one finished with
copying mysql-connector-java-5.1.36-bin.jar to /var/lib/ambari-server/resources
JDBC driver was successfully initialized.
Ambari Server ‘setup’ completed successfully.
I did restart the ambari server after that command and the problem still persisted. The resources directory shows a mysql-connector-java.jar as well as a mysql-connector-java-5.1.36-bin.jar. A mysql-jdbc-driver.jar is also in there.
I also checked that the .jar contains the Driver class in the com/mysql/jdbc/ folder.
↧
↧
Reply To: HUE 3.8 installation on HDP 2.3 & SLES 11 OS | problem with prerequisite package
Hi Deepak,
These packages are not HDP specific, so you should be able to find them online.
Unfortunately Hue 3.8.1 is not a Hortonworks project, so there isn’t much we can help there, have you tried to install the Hue 2.6.1 from HDP and use the packages it installs there? Then maybe you can upgrade Hue?
Thanks
Dave
↧
Export Data from hbase 0.90 and import into 1.0
Good afternoon everyone,
I’d like to leave my old version of hbase to install a new one. Actually, I’m using a cloudera package (CDH3), with these version :
– hbase : 0.90.4
– hadoop : 0.20.2
– zookeeper : 3.3.4
I’d like to install a version 1.0 of hbase and import my production data from my old configuation.
Is there a simple way to do a such task ?
Thanks a lot for any advice.
↧
Ranger Audit
Hi,
I have installed a cluster with Ambari 2.1.1 and Ranger 0.5.0.2.3 with a postgresql database. There are two databases in this postgresql named ranger and ranger_audit. I have also enabled the Ranger HDFS plugin through the Ambari web console and I’m able to apply policies to the HDFS service.
The problem comes when I activate the HDFS Audit to DB. I can see this messages into the HDFS log that repeats forever:
2015-09-29 14:24:56,983 ERROR utils.RangerCredentialProvider (RangerCredentialProvider.java:getCredentialProviders(80)) – Unable to get the Credential Provider from the Configuration
java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:392)
at com.sun.crypto.provider.JceKeyStore.engineLoad(JceKeyStore.java:698)
at java.security.KeyStore.load(KeyStore.java:1445)
at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.<init>(AbstractJavaKeyStoreProvider.java:106)
at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:49)
at org.apache.hadoop.security.alias.JavaKeyStoreProvider.<init>(JavaKeyStoreProvider.java:41)
at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100)
at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:58)
at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:78)
at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:54)
at org.apache.ranger.audit.provider.MiscUtil.getCredentialString(MiscUtil.java:410)
at org.apache.ranger.audit.destination.DBAuditDestination.connect(DBAuditDestination.java:152)
at org.apache.ranger.audit.destination.DBAuditDestination.getTransaction(DBAuditDestination.java:252)
at org.apache.ranger.audit.destination.DBAuditDestination.beginTransaction(DBAuditDestination.java:261)
at org.apache.ranger.audit.destination.DBAuditDestination.log(DBAuditDestination.java:84)
at org.apache.ranger.audit.provider.BaseAuditHandler.logJSON(BaseAuditHandler.java:161)
at org.apache.ranger.audit.queue.AuditFileSpool.sendEvent(AuditFileSpool.java:882)
at org.apache.ranger.audit.queue.AuditFileSpool.runDoAs(AuditFileSpool.java:830)
at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:759)
at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:757)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637)
at org.apache.ranger.audit.queue.AuditFileSpool.run(AuditFileSpool.java:765)
at java.lang.Thread.run(Thread.java:745)
2015-09-29 14:24:56,984 INFO destination.DBAuditDestination (DBAuditDestination.java:connect(164)) – JDBC Driver=org.postgresql.Driver, JDBC URL=jdbc:postgresql://sv01pronode01.datalab1.sp.ingdirect.intranet/ranger_audit, dbUser=rangerlogger, passwordAlias=auditDBCred, credFile=jceks://file/etc/ranger/datalab1_hadoop/cred.jceks, usingPassword=yes
2015-09-29 14:24:56,987 INFO destination.DBAuditDestination (DBAuditDestination.java:connect(180)) – entityManagerFactory=org.eclipse.persistence.internal.jpa.EntityManagerFactoryImpl@5e16dfa6
2015-09-29 14:24:56,990 ERROR destination.DBAuditDestination (DBAuditDestination.java:connect(195)) – Error connecting audit database. dbURL=jdbc:postgresql://sv01pronode01.datalab1.sp.ingdirect.intranet/ranger_audit, dbUser=rangerlogger
javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services – 2.5.2.v20131113-a7346c6): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: FATAL: password authentication failed for user “rangerlogger”
Error Code: 0
at org.eclipse.persistence.internal.jpa.EntityManagerSetupImpl.deploy(EntityManagerSetupImpl.java:766)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryDelegate.getAbstractSession(EntityManagerFactoryDelegate.java:204)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryDelegate.createEntityManagerImpl(EntityManagerFactoryDelegate.java:304)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryImpl.createEntityManagerImpl(EntityManagerFactoryImpl.java:336)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryImpl.createEntityManager(EntityManagerFactoryImpl.java:302)
at org.apache.ranger.audit.dao.DaoManager.getEntityManager(DaoManager.java:48)
at org.apache.ranger.audit.destination.DBAuditDestination.connect(DBAuditDestination.java:186)
at org.apache.ranger.audit.destination.DBAuditDestination.getTransaction(DBAuditDestination.java:252)
at org.apache.ranger.audit.destination.DBAuditDestination.beginTransaction(DBAuditDestination.java:261)
at org.apache.ranger.audit.destination.DBAuditDestination.log(DBAuditDestination.java:84)
at org.apache.ranger.audit.provider.BaseAuditHandler.logJSON(BaseAuditHandler.java:161)
at org.apache.ranger.audit.queue.AuditFileSpool.sendEvent(AuditFileSpool.java:882)
at org.apache.ranger.audit.queue.AuditFileSpool.runDoAs(AuditFileSpool.java:830)
at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:759)
at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:757)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637)
at org.apache.ranger.audit.queue.AuditFileSpool.run(AuditFileSpool.java:765)
at java.lang.Thread.run(Thread.java:745)
Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services – 2.5.2.v20131113-a7346c6): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: FATAL: password authentication failed for user “rangerlogger”
Error Code: 0
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:331)
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:326)
at org.eclipse.persistence.sessions.DefaultConnector.connect(DefaultConnector.java:138)
at org.eclipse.persistence.sessions.DatasourceLogin.connectToDatasource(DatasourceLogin.java:162)
at org.eclipse.persistence.internal.sessions.DatabaseSessionImpl.setOrDetectDatasource(DatabaseSessionImpl.java:204)
at org.eclipse.persistence.internal.sessions.DatabaseSessionImpl.loginAndDetectDatasource(DatabaseSessionImpl.java:741)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryProvider.login(EntityManagerFactoryProvider.java:239)
at org.eclipse.persistence.internal.jpa.EntityManagerSetupImpl.deploy(EntityManagerSetupImpl.java:685)
… 19 more
Caused by: org.postgresql.util.PSQLException: FATAL: password authentication failed for user “rangerlogger”
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:400)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:138)
at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31)
at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
at org.postgresql.Driver.makeConnection(Driver.java:410)
at org.postgresql.Driver.connect(Driver.java:280)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.eclipse.persistence.sessions.DefaultConnector.connect(DefaultConnector.java:98)
… 24 more
2015-09-29 14:24:56,992 ERROR destination.DBAuditDestination (DBAuditDestination.java:getEntityManager(223)) – DBAuditDestination.getEntityManager(): failed
javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services – 2.5.2.v20131113-a7346c6): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: FATAL: password authentication failed for user “rangerlogger”
Error Code: 0
at org.eclipse.persistence.internal.jpa.EntityManagerSetupImpl.deploy(EntityManagerSetupImpl.java:766)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryDelegate.getAbstractSession(EntityManagerFactoryDelegate.java:204)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryDelegate.createEntityManagerImpl(EntityManagerFactoryDelegate.java:304)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryImpl.createEntityManagerImpl(EntityManagerFactoryImpl.java:336)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryImpl.createEntityManager(EntityManagerFactoryImpl.java:302)
at org.apache.ranger.audit.dao.DaoManager.getEntityManager(DaoManager.java:48)
at org.apache.ranger.audit.destination.DBAuditDestination.getEntityManager(DBAuditDestination.java:221)
at org.apache.ranger.audit.destination.DBAuditDestination.getTransaction(DBAuditDestination.java:255)
at org.apache.ranger.audit.destination.DBAuditDestination.beginTransaction(DBAuditDestination.java:261)
at org.apache.ranger.audit.destination.DBAuditDestination.log(DBAuditDestination.java:84)
at org.apache.ranger.audit.provider.BaseAuditHandler.logJSON(BaseAuditHandler.java:161)
at org.apache.ranger.audit.queue.AuditFileSpool.sendEvent(AuditFileSpool.java:882)
at org.apache.ranger.audit.queue.AuditFileSpool.runDoAs(AuditFileSpool.java:830)
at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:759)
at org.apache.ranger.audit.queue.AuditFileSpool$2.run(AuditFileSpool.java:757)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1637)
at org.apache.ranger.audit.queue.AuditFileSpool.run(AuditFileSpool.java:765)
at java.lang.Thread.run(Thread.java:745)
Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services – 2.5.2.v20131113-a7346c6): org.eclipse.persistence.exceptions.DatabaseException
Internal Exception: org.postgresql.util.PSQLException: FATAL: password authentication failed for user “rangerlogger”
Error Code: 0
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:331)
at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:326)
at org.eclipse.persistence.sessions.DefaultConnector.connect(DefaultConnector.java:138)
at org.eclipse.persistence.sessions.DatasourceLogin.connectToDatasource(DatasourceLogin.java:162)
at org.eclipse.persistence.internal.sessions.DatabaseSessionImpl.setOrDetectDatasource(DatabaseSessionImpl.java:204)
at org.eclipse.persistence.internal.sessions.DatabaseSessionImpl.loginAndDetectDatasource(DatabaseSessionImpl.java:741)
at org.eclipse.persistence.internal.jpa.EntityManagerFactoryProvider.login(EntityManagerFactoryProvider.java:239)
at org.eclipse.persistence.internal.jpa.EntityManagerSetupImpl.deploy(EntityManagerSetupImpl.java:685)
… 19 more
Caused by: org.postgresql.util.PSQLException: FATAL: password authentication failed for user “rangerlogger”
at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:400)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:138)
at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31)
at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
at org.postgresql.Driver.makeConnection(Driver.java:410)
at org.postgresql.Driver.connect(Driver.java:280)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at org.eclipse.persistence.sessions.DefaultConnector.connect(DefaultConnector.java:98)
… 24 more
2015-09-29 14:24:56,992 INFO destination.DBAuditDestination (DBAuditDestination.java:cleanUp(201)) – DBAuditDestination: cleanUp()
2015-09-29 14:24:56,992 INFO provider.BaseAuditHandler (BaseAuditHandler.java:logStatus(301)) – Audit Status Log: name=hdfs.async.batch.db, interval=30.029 seconds, events=1, deferredCount=1, totalEvents=224, totalDeferredCount=223
2015-09-29 14:24:56,992 WARN destination.DBAuditDestination (DBAuditDestination.java:beginTransaction(268)) – DBAuditDestination.beginTransaction(): trx is null
2015-09-29 14:24:56,992 ERROR queue.AuditFileSpool (AuditFileSpool.java:logError(710)) – Error sending logs to consumer. provider=hdfs.async.batch, consumer=hdfs.async.batch.db
I checked the file /etc/ranger/datalab1_hadoop/cred.jceks and it has zero size. Seems that the namenode cannot get the credentials to access the audit database from the jceks. I can see other files with information:
1044 4 -rwx—— 1 ranger ranger 960 Sep 29 11:54 /etc/ranger/admin/rangeradmin.jceks
1067 0 -rw-r–r– 1 hdfs hdfs 0 Sep 29 11:59 /etc/ranger/datalab1_hadoop/cred.jceks
1037 4 -rwx—— 1 ranger ranger 995 Sep 29 11:47 /etc/ranger-usersync/2.3.0.0-2557/0/ugsync.jceks
Can you help me?
Thank you
↧