Hortonworks » All Replies

Hi,

I’m a starter here. I have created a table:

create TABLE US_ABC (CARD_ACCT_NO string, BTCH_ID string, VLD_RULE_SHRT_NM string, RULE_PATH_TX string, RULE_EXEC_PATH_TX string,LST_UPDT_TS string, RPT_MO string) ROW FORMAT DELIMITED FIELDS TERMINATED BY “|”;

and loaded data in this table.

I’m trying to run a simple query :

select * from us_abc where CARD_ACCT_NO = ‘12323232313’ ;

This is not giving me any output. In fact I tried this with multiple where clauses and the result is the same. Following is the output:

Total jobs = 1

Launching Job 1 out of 1

Number of reduce tasks is set to 0 since there’s no reduce operator

Starting Job = job_201509111551_7140, Tracking URL = http://lppbd0020.gso.aexp.com:50030/jobdetails.jsp?jobid=job_201509111551_7140

Kill Command = /opt/mapr/hadoop/hadoop-0.20.2/bin/../bin/hadoop job -kill job_201509111551_7140

Hadoop job information for Stage-1: number of mappers: 9; number of reducers: 0

2015-09-25 02:53:44,819 Stage-1 map = 0%, reduce = 0%

2015-09-25 02:53:52,891 Stage-1 map = 22%, reduce = 0%, Cumulative CPU 6.79 sec

2015-09-25 02:53:53,912 Stage-1 map = 89%, reduce = 0%, Cumulative CPU 30.35 sec

2015-09-25 02:53:54,925 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 35.17 sec

MapReduce Total cumulative CPU time: 35 seconds 170 msec

Ended Job = job_201509111551_7140

MapReduce Jobs Launched:

Job 0: Map: 9 Cumulative CPU: 35.17 sec MAPRFS Read: 0 MAPRFS Write: 0 SUCCESS

Total MapReduce CPU Time Spent: 35 seconds 170 msec

Time taken: 11.486 seconds

Hi Guys resolved this issue! Plz try running this on Virtual Box version 4.2.13 build 93733. It runs HN Sandbox 2.2 successfully. Kindly choose your vm settings carefully , such as Linux version to be 64 bit (as in my case). Network settings, CD/DVD / Floppy options to be unchecked Under system settings.

It seems due to hardened security in Oracle Virtual Box 4.2.20, I was unable to run this VBox in Windows 10 Pro. But there needs to be fix from Oracle to make this run successfully for later / latest versions as well.

However, 4.2.13 successfully runs virtual box and Sandbox 2.2 in Windows 10 Pro.

Thanks
–

Where is the best source to check compatibility between hbase-client and the hbase service? Specifically, will hbase-client 0.98 running on JDK 1.6 be compatible with a remote HBase service running hbase 1.1 on JDK 1.7?

with hadoop and spark 1.4.1, i get issue with mahout, not compatible with 1.4.1 spark, may be i msut check if new release mahout is solve this issue.

Hi,

I got the same exact issue. It also tried mirroring the repositories (w/ reposync) and I’m getting the same *.el6* packages as in the tarballs.

I could install HDP 2.3 on RHEL7.1 anyway, though I got a yum dependancy issue on snappy (version in RHEL7.1 is more recent that the one shipped with HDP).

I would love to see someone reply on the official RHEL7.x/CentOS7.x support status.

Hi,

Im looking for this hive 0.14 ODBC drivers for RHEL 64 bit. Can anyone please help get these drivers.

Hi there,
I am new to the HDP. I have installed 2.3 virtualBox on my machine. I made my pig scripts working via SSH, but could not make them working via the Pig Editor. It always gives me the error of “Could not resolve org.apache.hive.hcatalog.pig.HCatLoader”. I know this could be an environment issue. (remember my pig scripts are working fine in SSH). My question is that when I hit the “execute” button on web, what command does it send into? Does it call /usr/bin/pig? I even made the /usr/bin/pig invalid. it was still giving me the same error.

Resolved by following the these steps:
http://idavit.blogspot.mx/2014/12/como-no-morir-en-el-intento-primer.html

ok my proble seem into kernel.json

if i add the env value, i get kernel error, if i remove the env content, i get working
but it dont find sparkcontext

“env”: {
“SPARK_HOME”: “C:/bigdatadev/spark-1.4.1-bin-hadoop2.6/”,
“PYSPARK_SUBMIT_ARGS”: “–master local[2] pyspark-shell”,
“PYTHONPATH”: “C:/bigdatadev/spark-1.4.1-bin-hadoop2.6/python/lib/py4j-0.8.2.1-src.zip”
}

We are experimenting with HDP but not getting anywhere with it..

AMBARI Fails at this stage
Confirm Hosts
Registering your hosts.
Please confirm the host list and remove any hosts that you do not want to include in the cluster. STATUS = FAILED

Our Ambari log says the following. Please help troubleshoot this.

INFO:root:BootStrapping hosts [‘master.cvserver.com’] using /usr/lib/python2.6/site-packages/ambari_server cluster primary OS: redhat6 with user ‘root’ sshKey File /var/run/ambari-server/bootstrap/18/sshKey password File null using tmp dir /var/run/ambari-server/bootstrap/18 ambari: master.cvserver.com; server_port: 8082; ambari version: 2.1.1; user_run_as: root
INFO:root:Executing parallel bootstrap
ERROR:root:ERROR: Bootstrap of host master.cvserver.com fails because previous action finished with non-zero exit code (255)
ERROR MESSAGE: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

STDOUT:
Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

INFO:root:Finished parallel bootstrap

25 Sep 2015 20:50:24,181 INFO [pool-19-thread-1] BSHostStatusCollector:55 – Request directory /var/run/ambari-server/bootstrap/18
25 Sep 2015 20:50:24,181 INFO [pool-19-thread-1] BSHostStatusCollector:62 – HostList for polling on [master.cvserver.com]
25 Sep 2015 22:13:34,185 INFO [Thread-1] ContextHandler:843 – stopped o.e.j.s.ServletContextHandler{/,file:/usr/lib/ambari-server/web/}
25 Sep 2015 22:13:34,192 INFO [Thread-1] ELContextCleaner:63 – javax.el.BeanELResolver purged
25 Sep 2015 22:13:34,193 INFO [Thread-1] ContextHandler:843 – stopped o.e.j.w.WebAppContext{/views/ADMIN_VIEW/2.1.1/INSTANCE,file:/var/lib/ambari-server/resources/views/work/ADMIN_VIEW%7B2.1.1%7D/},/var/lib/ambari-server/resources/views/work/ADMIN_VIEW{2.1.1}
25 Sep 2015 22:13:34,250 INFO [main] AmbariServer:516 – Joined the Server
25 Sep 2015 22:13:34,303 INFO [Thread-1] ContextHandler:843 – stopped o.e.j.s.ServletContextHandler{/,null}
25 Sep 2015 22:14:11,140 INFO [main] Configuration:637 – Reading password from existing file
25 Sep 2015 22:14:11,168 INFO [main] Configuration:915 – Hosts Mapping File null
25 Sep 2015 22:14:11,169 INFO [main] HostsMap:60 – Using hostsmap file null
25 Sep 2015 22:14:11,767 INFO [main] ControllerModule:185 – Detected POSTGRES as the database type from the JDBC URL
25 Sep 2015 22:14:13,053 INFO [main] ControllerModule:560 – Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.EmailDispatcher
25 Sep 2015 22:14:13,056 INFO [main] ControllerModule:560 – Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.AlertScriptDispatcher
25 Sep 2015 22:14:13,167 INFO [main] ControllerModule:560 – Binding and registering notification dispatcher class org.apache.ambari.server.notifications.dispatchers.SNMPDispatcher
25 Sep 2015 22:14:16,853 INFO [main] AmbariServer:709 – Getting the controller
25 Sep 2015 22:14:18,585 INFO [main] StackManager:107 – Initializing the stack manager…
25 Sep 2015 22:14:18,585 INFO [main] StackManager:267 – Validating stack directory /var/lib/ambari-server/resources/stacks …
25 Sep 2015 22:14:18,585 INFO [main] StackManager:243 – Validating common services directory /var/lib/ambari-server/resources/common-services …
25 Sep 2015 22:14:19,347 INFO [main] StackDirectory:426 – Stack ‘/var/lib/ambari-server/resources/stacks/HDP/2.0’ doesn’t contain an upgrade directory
25 Sep 2015 22:14:19,379 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.0/role_command_order.json
25 Sep 2015 22:14:19,382 INFO [main] StackDirectory:426 – Stack ‘/var/lib/ambari-server/resources/stacks/HDP/2.0.6.GlusterFS’ doesn’t contain an upgrade directory
25 Sep 2015 22:14:19,414 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.0.6.GlusterFS/role_command_order.json
25 Sep 2015 22:14:19,464 INFO [main] StackDirectory:426 – Stack ‘/var/lib/ambari-server/resources/stacks/HDP/2.0.6’ doesn’t contain an upgrade directory
25 Sep 2015 22:14:19,542 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.0.6/role_command_order.json
25 Sep 2015 22:14:19,546 INFO [main] StackDirectory:426 – Stack ‘/var/lib/ambari-server/resources/stacks/HDP/2.1’ doesn’t contain an upgrade directory
25 Sep 2015 22:14:19,584 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.1/role_command_order.json
25 Sep 2015 22:14:19,606 INFO [main] StackDirectory:426 – Stack ‘/var/lib/ambari-server/resources/stacks/HDP/2.3.GlusterFS’ doesn’t contain an upgrade directory
25 Sep 2015 22:14:19,667 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.3.GlusterFS/role_command_order.json
25 Sep 2015 22:14:19,776 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.3/role_command_order.json
25 Sep 2015 22:14:20,062 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.2/role_command_order.json
25 Sep 2015 22:14:20,153 INFO [main] StackDirectory:426 – Stack ‘/var/lib/ambari-server/resources/stacks/HDP/2.1.GlusterFS’ doesn’t contain an upgrade directory
25 Sep 2015 22:14:20,193 INFO [main] StackDirectory:447 – Role command order info was loaded from file: /var/lib/ambari-server/resources/stacks/HDP/2.1.GlusterFS/role_command_order.json
25 Sep 2015 22:14:21,123 INFO [Stack Version Loading Thread] LatestRepoCallable:74 – Loading latest URL info for stack HDP-2.1 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
25 Sep 2015 22:14:21,145 ERROR [Stack Version Loading Thread] LatestRepoCallable:93 – Could not load the URI for stack HDP-2.1 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (public-repo-1.hortonworks.com)
25 Sep 2015 22:14:21,145 INFO [Stack Version Loading Thread] LatestRepoCallable:74 – Loading latest URL info for stack HDP-2.2 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
25 Sep 2015 22:14:21,146 ERROR [Stack Version Loading Thread] LatestRepoCallable:93 – Could not load the URI for stack HDP-2.2 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (public-repo-1.hortonworks.com)
25 Sep 2015 22:14:21,146 INFO [Stack Version Loading Thread] LatestRepoCallable:74 – Loading latest URL info for stack HDP-2.3 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
25 Sep 2015 22:14:21,147 ERROR [Stack Version Loading Thread] LatestRepoCallable:93 – Could not load the URI for stack HDP-2.3 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (public-repo-1.hortonworks.com)
25 Sep 2015 22:14:21,148 INFO [Stack Version Loading Thread] LatestRepoCallable:74 – Loading latest URL info for stack HDP-2.1.GlusterFS from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
25 Sep 2015 22:14:21,148 INFO [main] ActionDefinitionManager:124 – Added custom action definition for check_host
25 Sep 2015 22:14:21,149 ERROR [Stack Version Loading Thread] LatestRepoCallable:93 – Could not load the URI for stack HDP-2.1.GlusterFS from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (public-repo-1.hortonworks.com)
25 Sep 2015 22:14:21,149 INFO [main] ActionDefinitionManager:124 – Added custom action definition for validate_configs
25 Sep 2015 22:14:21,149 INFO [Stack Version Loading Thread] LatestRepoCallable:74 – Loading latest URL info for stack HDP-2.3.GlusterFS from http://s3.amazonaws.com/dev.hortonworks.com/HDP/hdp_urlinfo.json
25 Sep 2015 22:14:21,149 INFO [main] ActionDefinitionManager:124 – Added custom action definition for install_packages
25 Sep 2015 22:14:21,149 INFO [main] ActionDefinitionManager:124 – Added custom action definition for ru_execute_tasks
25 Sep 2015 22:14:21,150 ERROR [Stack Version Loading Thread] LatestRepoCallable:93 – Could not load the URI for stack HDP-2.3.GlusterFS from http://s3.amazonaws.com/dev.hortonworks.com/HDP/hdp_urlinfo.json (s3.amazonaws.com)
25 Sep 2015 22:14:21,151 INFO [Stack Version Loading Thread] LatestRepoCallable:74 – Loading latest URL info for stack HDP-2.0 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
25 Sep 2015 22:14:21,151 ERROR [Stack Version Loading Thread] LatestRepoCallable:93 – Could not load the URI for stack HDP-2.0 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (public-repo-1.hortonworks.com)
25 Sep 2015 22:14:21,154 INFO [main] CertificateManager:68 – Initialization of root certificate
25 Sep 2015 22:14:21,154 INFO [main] CertificateManager:70 – Certificate exists:true
25 Sep 2015 22:14:21,296 INFO [main] Configuration:723 – Credential provider creation failed. Reason: Master key initialization failed.
25 Sep 2015 22:14:21,312 INFO [main] ClustersImpl:160 – Initializing the ClustersImpl
25 Sep 2015 22:14:21,705 INFO [main] AmbariManagementControllerImpl:297 – Initializing the AmbariManagementControllerImpl
25 Sep 2015 22:14:21,810 INFO [main] DatabaseChecker:151 – Checking DB store version
25 Sep 2015 22:14:21,812 INFO [main] DatabaseChecker:177 – DB store version is compatible
25 Sep 2015 22:14:21,812 INFO [main] DatabaseChecker:55 – Checking DB consistency
25 Sep 2015 22:14:21,814 INFO [main] DatabaseChecker:143 – DB consistency check passed.
25 Sep 2015 22:14:21,834 INFO [main] ClassPathXmlApplicationContext:456 – Refreshing org.springframework.context.support.ClassPathXmlApplicationContext@5216532a: startup date [Fri Sep 25 22:14:21 UTC 2015]; root of context hierarchy
25 Sep 2015 22:14:21,886 INFO [main] DefaultListableBeanFactory:557 – Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@180fb796: defining beans []; root of factory hierarchy
25 Sep 2015 22:14:21,899 INFO [main] ClassPathXmlApplicationContext:456 – Refreshing org.springframework.context.support.ClassPathXmlApplicationContext@75507e68: startup date [Fri Sep 25 22:14:21 UTC 2015]; parent: org.springframework.context.support.ClassPathXmlApplicationContext@5216532a
25 Sep 2015 22:14:21,901 INFO [main] XmlBeanDefinitionReader:315 – Loading XML bean definitions from class path resource [webapp/WEB-INF/spring-security.xml]
25 Sep 2015 22:14:22,090 INFO [main] SpringSecurityCoreVersion:33 – You are running with Spring Security Core 3.1.2.RELEASE
25 Sep 2015 22:14:22,090 INFO [main] SecurityNamespaceHandler:59 – Spring Security ‘config’ module version is 3.1.2.RELEASE
25 Sep 2015 22:14:22,131 INFO [main] FilterInvocationSecurityMetadataSourceParser:134 – Creating access control expression attribute ‘isAuthenticated()’ for /**
25 Sep 2015 22:14:22,151 INFO [main] HttpSecurityBeanDefinitionParser:264 – Checking sorted filter chain: [Root bean: class [org.springframework.security.web.context.SecurityContextPersistenceFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 300, Root bean: class [org.springframework.security.web.authentication.www.BasicAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1200, <ambariAuthorizationFilter>, order = 1201, Root bean: class [org.springframework.security.web.savedrequest.RequestCacheAwareFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1300, Root bean: class [org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1400, Root bean: class [org.springframework.security.web.authentication.AnonymousAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1700, Root bean: class [org.springframework.security.web.session.SessionManagementFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1800, Root bean: class [org.springframework.security.web.access.ExceptionTranslationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1900, <org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0>, order = 2000]
25 Sep 2015 22:14:22,168 INFO [main] DefaultListableBeanFactory:557 – Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@537a8915: defining beans [org.springframework.security.filterChains,org.springframework.security.filterChainProxy,org.springframework.security.web.PortMapperImpl#0,org.springframework.security.web.PortResolverImpl#0,org.springframework.security.config.authentication.AuthenticationManagerFactoryBean#0,org.springframework.security.authentication.ProviderManager#0,org.springframework.security.web.context.HttpSessionSecurityContextRepository#0,org.springframework.security.web.authentication.session.SessionFixationProtectionStrategy#0,org.springframework.security.web.savedrequest.HttpSessionRequestCache#0,org.springframework.security.web.access.expression.DefaultWebSecurityExpressionHandler#0,org.springframework.security.access.vote.AffirmativeBased#0,org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0,org.springframework.security.web.access.DefaultWebInvocationPrivilegeEvaluator#0,org.springframework.security.authentication.AnonymousAuthenticationProvider#0,org.springframework.security.userDetailsServiceFactory,org.springframework.security.web.DefaultSecurityFilterChain#0,org.springframework.security.authentication.dao.DaoAuthenticationProvider#0,org.springframework.security.authentication.DefaultAuthenticationEventPublisher#0,org.springframework.security.authenticationManager,ambariEntryPoint]; parent: org.springframework.beans.factory.support.DefaultListableBeanFactory@180fb796
25 Sep 2015 22:14:22,355 INFO [main] DefaultSecurityFilterChain:28 – Creating filter chain: org.springframework.security.web.util.AnyRequestMatcher@1, [org.springframework.security.web.context.SecurityContextPersistenceFilter@30a4a111, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@7f6a6d46, org.apache.ambari.server.security.authorization.AmbariAuthorizationFilter@238a7e3d, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@7ed5cc8c, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@6bec566e, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@47400608, org.springframework.security.web.session.SessionManagementFilter@374bf34b, org.springframework.security.web.access.ExceptionTranslationFilter@67aaf882, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@6efc9d3f]
25 Sep 2015 22:14:22,404 INFO [main] Configuration:906 – Web App DIR test /usr/lib/ambari-server/web
25 Sep 2015 22:14:22,413 INFO [main] CertificateManager:68 – Initialization of root certificate
25 Sep 2015 22:14:22,413 INFO [main] CertificateManager:70 – Certificate exists:true
25 Sep 2015 22:14:22,491 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/capacity-scheduler-2.1.1.236.jar.
25 Sep 2015 22:14:22,819 INFO [main] ViewRegistry:1551 – View deployed: CAPACITY-SCHEDULER{1.0.0}.
25 Sep 2015 22:14:22,857 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/ambari-admin-2.1.1.236.jar.
25 Sep 2015 22:14:22,943 INFO [main] ViewRegistry:1551 – View deployed: ADMIN_VIEW{2.1.1}.
2
25 Sep 2015 22:14:22,943 INFO [main] ViewRegistry:1551 – View deployed: ADMIN_VIEW{2.1.1}.
25 Sep 2015 22:14:22,967 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/slider-2.1.1.236.jar.
25 Sep 2015 22:14:23,352 INFO [main] ViewRegistry:1551 – View deployed: SLIDER{2.0.0}.
25 Sep 2015 22:14:23,372 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/pig-2.1.1.236.jar.
25 Sep 2015 22:14:23,557 INFO [main] ViewRegistry:1551 – View deployed: PIG{1.0.0}.
25 Sep 2015 22:14:23,575 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/hive-2.1.1.236.jar.
25 Sep 2015 22:14:23,938 INFO [main] ViewRegistry:1551 – View deployed: HIVE{1.0.0}.
25 Sep 2015 22:14:23,953 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/tez-view-2.1.1.236.jar.
25 Sep 2015 22:14:23,986 INFO [main] ViewRegistry:1551 – View deployed: TEZ{0.7.0.2.3.0.0-236}.
25 Sep 2015 22:14:24,012 INFO [main] ViewRegistry:1526 – Reading view archive /var/lib/ambari-server/resources/views/files-2.1.1.236.jar.
25 Sep 2015 22:14:24,211 INFO [main] ViewRegistry:1551 – View deployed: FILES{1.0.0}.
25 Sep 2015 22:14:24,221 INFO [main] AmbariServer:471 – ********* Initializing Clusters **********
25 Sep 2015 22:14:24,222 INFO [main] AmbariServer:475 – ********* Current Clusters State *********
25 Sep 2015 22:14:24,222 INFO [main] AmbariServer:476 – Clusters=[ ]
25 Sep 2015 22:14:24,222 INFO [main] AmbariServer:478 – ********* Reconciling Alert Definitions **********
25 Sep 2015 22:14:24,223 INFO [main] AmbariServer:481 – ********* Initializing ActionManager **********
25 Sep 2015 22:14:24,223 INFO [main] AmbariServer:483 – ********* Initializing Controller **********
25 Sep 2015 22:14:24,223 INFO [main] AmbariServer:487 – ********* Initializing Scheduled Request Manager **********
25 Sep 2015 22:14:24,309 INFO [main] Server:272 – jetty-8.1.17.v20150415
25 Sep 2015 22:14:27,327 INFO [main] AbstractConnector:338 – Started SelectChannelConnector@0.0.0.0:8082
25 Sep 2015 22:14:27,328 INFO [main] Server:272 – jetty-8.1.17.v20150415
25 Sep 2015 22:14:30,257 INFO [main] SslContextFactory:300 – Enabled Protocols [SSLv2Hello, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
25 Sep 2015 22:14:30,291 INFO [main] AbstractConnector:338 – Started SslSelectChannelConnector@0.0.0.0:8440
25 Sep 2015 22:14:30,360 INFO [main] SslContextFactory:300 – Enabled Protocols [SSLv2Hello, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
25 Sep 2015 22:14:30,380 INFO [main] AbstractConnector:338 – Started SslSelectChannelConnector@0.0.0.0:8441
25 Sep 2015 22:14:30,380 INFO [main] AmbariServer:504 – ********* Started Server **********
25 Sep 2015 22:14:30,380 INFO [main] ActionManager:78 – Starting scheduler thread
25 Sep 2015 22:14:30,385 INFO [main] ServerActionExecutor:136 – Starting Server Action Executor thread…
25 Sep 2015 22:14:30,386 INFO [main] ServerActionExecutor:163 – Server Action Executor thread started.
25 Sep 2015 22:14:30,386 INFO [main] AmbariServer:507 – ********* Started ActionManager **********
25 Sep 2015 22:14:30,386 INFO [main] ExecutionScheduleManager:201 – Starting scheduler
25 Sep 2015 22:14:30,630 INFO [main] MLog:80 – MLog clients using log4j logging.
25 Sep 2015 22:14:30,957 INFO [main] C3P0Registry:204 – Initializing c3p0-0.9.1.1 [built 15-March-2007 01:32:31; debug? true; trace: 10]
25 Sep 2015 22:14:31,073 INFO [main] StdSchedulerFactory:1184 – Using default implementation for ThreadExecutor
25 Sep 2015 22:14:31,121 INFO [main] SchedulerSignalerImpl:61 – Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
25 Sep 2015 22:14:31,121 INFO [main] QuartzScheduler:240 – Quartz Scheduler v.2.2.1 created.
25 Sep 2015 22:14:31,122 INFO [main] JobStoreTX:670 – Using thread monitor-based data access locking (synchronization).
25 Sep 2015 22:14:31,123 INFO [main] JobStoreTX:59 – JobStoreTX initialized.
25 Sep 2015 22:14:31,125 INFO [main] QuartzScheduler:305 – Scheduler meta-data: Quartz Scheduler (v2.2.1) ‘ExecutionScheduler’ with instanceId ‘NON_CLUSTERED’

Scheduler class: ‘org.quartz.core.QuartzScheduler’ – running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool ‘org.quartz.simpl.SimpleThreadPool’ – with 5 threads.
Using job-store ‘org.quartz.impl.jdbcjobstore.JobStoreTX’ – which supports persistence. and is not clustered.

25 Sep 2015 22:14:31,125 INFO [main] StdSchedulerFactory:1339 – Quartz scheduler ‘ExecutionScheduler’ initialized from an externally provided properties instance.
25 Sep 2015 22:14:31,125 INFO [main] StdSchedulerFactory:1343 – Quartz scheduler version: 2.2.1
25 Sep 2015 22:14:31,125 INFO [main] QuartzScheduler:2311 – JobFactory set to: org.apache.ambari.server.state.scheduler.GuiceJobFactory@fffb4a8
25 Sep 2015 22:14:31,126 INFO [main] AmbariServer:510 – ********* Started Scheduled Request Manager **********
25 Sep 2015 22:14:31,147 INFO [main] AmbariServer:513 – ********* Started Services **********
25 Sep 2015 22:16:31,230 INFO [Thread-23] AbstractPoolBackedDataSource:462 – Initializing c3p0 pool… com.mchange.v2.c3p0.ComboPooledDataSource [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, dataSourceName -> 193tn2y9c1tn8jv15wfgd5|5d00241b, debugUnreturnedConnectionStackTraces -> false, description -> null, driverClass -> org.postgresql.Driver, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, identityToken -> 193tn2y9c1tn8jv15wfgd5|5d00241b, idleConnectionTestPeriod -> 50, initialPoolSize -> 3, jdbcUrl -> jdbc:postgresql://master.cvserver.com:5432/cvbdat, lastAcquisitionFailureDefaultUser -> null, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 0, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 5, maxStatements -> 0, maxStatementsPerConnection -> 120, minPoolSize -> 1, numHelperThreads -> 3, numThreadsAwaitingCheckoutDefaultUser -> 0, preferredTestQuery -> select 0, properties -> {user=******, password=******}, propertyCycle -> 0, testConnectionOnCheckin -> true, testConnectionOnCheckout -> false, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false ]
25 Sep 2015 22:16:31,304 INFO [Thread-23] JobStoreTX:861 – Freed 0 triggers from ‘acquired’ / ‘blocked’ state.
25 Sep 2015 22:16:31,327 INFO [Thread-23] JobStoreTX:871 – Recovering 0 jobs that were in-progress at the time of the last shut-down.
25 Sep 2015 22:16:31,328 INFO [Thread-23] JobStoreTX:884 – Recovery complete.
25 Sep 2015 22:16:31,329 INFO [Thread-23] JobStoreTX:891 – Removed 0 ‘complete’ triggers.
25 Sep 2015 22:16:31,332 INFO [Thread-23] JobStoreTX:896 – Removed 0 stale fired job entries.
25 Sep 2015 22:16:31,336 INFO [Thread-23] QuartzScheduler:575 – Scheduler ExecutionScheduler_$_NON_CLUSTERED started.

Hi,

please help me to understand the below lines. if any one share the document with step by step. it would be better understanding.

3.2. Use an Existing Active Directory

To use an existing Active Directory domain for the cluster with Automated Kerberos Setup, you must prepare the following:

Ambari Server and cluster hosts have network access to, and be able to resolve the DNS names of, the Domain Controllers.

Active Directory secure LDAP (LDAPS) connectivity has been configured.

Active Directory User container for principals has been created and is on-hand. For example, “OU=Hadoop,OU=People,dc=apache,dc=org”

Active Directory administrative credentials with delegated control of “Create, delete, and manage user accounts” on the previously mentioned User container are on-hand.

Thanks in Advance.

Sankar.R

</div>

Reply To: Issue with Ambari start

Reply To: browser time out when using Sandbox IP

Reply To: Better UI for HDinsight

namenode in loop forever leasemanager HDFS-4882

Reply To: Correct steps to setup Ambari on a CentOS VM

unable to access the yarn config's page

Installing HN Sandbox 2.2 on Windows 10

Hive Query Resulting in No Output

Reply To: Installing HN Sandbox 2.2 on Windows 10

Best source?

Reply To: Spark 1.4.1 Technical Preview available

Reply To: Centos7 repository tarballs are outdated?

hive-odbc-native–.x86_64.rpm for 64-bit

Pig script can be run via SSH but not Pig Editor

Reply To: Pig script can be run via SSH but not Pig Editor

Reply To: Anadonca Python 2.7/Ipython 3.2.0 and pyspark – kernel error ipython notebook

Ambari fails to register

AD Authentication on HDP 2.3

Reply To: HIVE – JSON-Serde problems

Reply To: Spark 1.4.1 Technical Preview available