how to fetch a value from persistence.xml to build.properties?

Cloudera (company): Oozie samples can not run on CDH4 YARN cluster?

• I build a CDH4 YARN cluster on Ubuntu 12.04 64bit. The cluster and other components, as HBase, Pig, Hive, Hue, Flume, Sqoop, all work fine. Then I follow cloudera's official document to install Oozie. Both command line and web console are OK. But if I run the examples, they always fail. The error message says "Map/Reduce failed, error message[HadoopAccessorException: E0902: Exception occured: [http://java.net.ConnectException: Call From cdh4-yarn-host-1/192.168.1.121 to cdh4-yarn-host-1:8021 failed on connection exception: http://java.net.ConnectException: Connection refused". I find that the problem is in this line, "jobtracker=<hostname>:8021" in job.properties file, because port 8021 is not used in YARN. I change it to other port e.g. 8030, it does not work. I think the examples are for MRv1, not YARN. So what is correct configuration? Below is how I install oozie: sudo apt-get install oozie oozie-client mysql -u root -p mysql> create database oozie; mysql> grant all privileges on oozie.* to 'oozie'@'cdh4-yarn-host-1' identified by 'oozie'; mysql> grant all privileges on oozie.* to 'oozie'@'cdh4-yarn-host-1' identified by 'oozie'; mysql> exit sudo vi /etc/oozie/conf.dist/oozie-site.xml     <property>         <name>oozie.service.JPAService.jdbc.driver</name>         <value>com.mysql.jdbc.Driver</value>     </property>     <property>         <name>oozie.service.JPAService.jdbc.url</name>         <value>jdbc:mysql://cdh4-yarn-host-1:3306/oozie</value>     </property>     <property>         <name>oozie.service.JPAService.jdbc.username</name>         <value>oozie</value>     </property>     <property>         <name>oozie.service.JPAService.jdbc.password</name>         <value>oozie</value>     </property> sudo apt-get install mysql-client dpkg -L libmysql-java sudo cp /usr/share/java/mysql-connector-java-5.1.16.jar /var/lib/oozie/ sudo -u oozie /usr/lib/oozie/bin/http://ooziedb.sh create -run sudo -u oozie /usr/lib/oozie/bin/http://ooziedb.sh create -sqlfile oozie-create.sql sudo -u hdfs hadoop fs -mkdir /user/oozie/share sudo -u hdfs hadoop fs -chown oozie /user/oozie/share mkdir /tmp/ooziesharelib cd /tmp/ooziesharelib wget http://dev.sencha.com/deploy/ext-2.2.zip unzip ext-2.2.zip sudo cp -r ext-2.2 /var/lib/oozie sudo tar xzf /usr/lib/oozie/oozie-sharelib-yarn.tar.gz sudo -u oozie hadoop fs -put share /user/oozie/share sudo vi /etc/hadoop/conf.empty/core-site.xml <property>   <name>hadoop.proxyuser.oozie.hosts</name>   <value>*</value> </property> <property>   <name>hadoop.proxyuser.oozie.groups</name>   <value>*</value> </property> sudo service oozie start oozie admin -oozie http://cdh4-yarn-host-1:11000/oozie -status cp /usr/share/doc/oozie/oozie-examples.tar.gz downloads/ cd downloads/ tar xzf oozie-examples.tar.gz vi examples/apps/map-reduce/job.properties hadoop fs -put examples examples oozie job -oozie http://cdh4-yarn-host-1:11000/oozie -config examples/apps/map-reduce/job.properties -run oozie job -oozie http://cdh4-yarn-host-1:11000/oozie -info 0000009-120925145709725-oozie-oozi-W

• Answer:

  In /etc/oozie/conf/http://oozie-env.sh check that CATALINA_BASE points to /usr/lib/oozie/oozie-server (and not oozie-server-0.20). Oozie will then use the YARN hadoop jars (and yes, the jobtracker host:port needs to be replaced by the resource manager host:port).