[yarn] Major YARN-Client improvements
- HDFS security token support - "ship/" directory to transfer files to all TaskManagers (user-files) - Log4j-based logging (YARN now respects the logging configuration) - the YARN-client deletes all "temp" files from HDFS. - The JVMs started by YARN now respect the configured JVM opts in the yaml-file - the JobManager webinterface shows the log file (e.g it is aware of the YARN-specific log-directory) - The YARN-client now creates a hidden ".yarn-jobmanager" with the address of the JobManager in YARN. users do not have to specify the -m argument anymore. - Fix a little bug with the JobManager's "cloud" model for taskManager with less that 1GB memory. - Tested on Cloudera Hadoop 5 Beta 2 - Tested on Cloduera Hadoop 5 Beta 2 WITH CDH5-B2 Maven Dependencies. - Tested on Hadoop 2.2.0 - Tested on Amazon EMR
Showing
想要评论请 注册 或 登录