big data

[asu126]

• hive 教程 https://www.yiibai.com/hive/hive_create_table.html
• 其它错误： https://www.cnblogs.com/gnivor/p/5005277.html
• matestore 初始化 https://askubuntu.com/questions/1073035/failed-hiveexception-java-lang-runtimeexception-unable-to-instantiate-org-apac
• Hive技术原理解析 https://blog.csdn.net/wangyang1354/article/details/50570903

[asu126]

• https://www.w3cschool.cn/spark/oja5zozt.html
• https://www.zybuluo.com/jewes/note/35032
• https://www.zhihu.com/question/23036370

[asu126]

开始

• java 安装

# install jdk1.8
- name: unpack java1.8 tar to remote
  unarchive: src=server-jre-8u144-linux-x64.tar.gz dest=/tmp

- name: install java
  shell: "{{ item }}"
  with_items:
    - sudo mkdir -p /usr/lib/jvm
    - sudo mv /tmp/jdk1.8.0_144 /usr/lib/jvm/
    - test -f /usr/bin/java && sudo rm /usr/bin/java
    - test -f /usr/bin/javac && sudo rm /usr/bin/javac
    - test -f /etc/alternatives/java && sudo rm /etc/alternatives/java
    - test -d /usr/lib/jvm/jdk1.8.0_111 && rm -rf /usr/lib/jvm/jdk1.8.0_111
    - sudo update-alternatives --install "/usr/bin/java" "java" "/usr/lib/jvm/jdk1.8.0_144/bin/java" 1
    - sudo update-alternatives --install "/usr/bin/javac" "javac" "/usr/lib/jvm/jdk1.8.0_144/bin/javac" 1
    - sudo chmod a+x /usr/bin/java
    - sudo chmod a+x /usr/bin/javac
    - sudo chown -R root:root /usr/lib/jvm/jdk1.8.0_144
    - sudo update-alternatives --config java

JobConf conf = new JobConf(new Configuration()); 

• 易百教程
• w3school
• Apache Hadoop 入门教程
• 官方文档

[asu126]

https://www.w3cschool.cn/spark/c1hfzozt.html

[asu126]

for eclipse

• http://blog.leanote.com/post/2630794313@qq.com/%E5%9F%BA%E4%BA%8EEclipse%E6%90%AD%E5%BB%BAhadoop%E5%BC%80%E5%8F%91%E7%8E%AF%E5%A2%83
• https://my.oschina.net/muou/blog/408543
• https://blog.51cto.com/acesdream/1623896

[asu126]

集群

• http://www.ityouknow.com/hadoop/2017/07/24/hadoop-cluster-setup.html

高可用

• https://blog.csdn.net/kezhong_wxl/article/details/76599440
• https://www.ibm.com/developerworks/cn/opensource/os-cn-hadoop-name-node/index.html

[asu126]

集群

• https://my.oschina.net/u/2500254/blog/806114
• http://www.ityouknow.com/hadoop/2017/07/24/hadoop-cluster-setup.html
• http://www.cnblogs.com/lanxuezaipiao/p/3525554.html
• https://www.polarxiong.com/archives/Hadoop-Intellij%E7%BB%93%E5%90%88Maven%E6%9C%AC%E5%9C%B0%E8%BF%90%E8%A1%8C%E5%92%8C%E8%B0%83%E8%AF%95MapReduce%E7%A8%8B%E5%BA%8F-%E6%97%A0%E9%9C%80%E6%90%AD%E8%BD%BDHadoop%E5%92%8CHDFS%E7%8E%AF%E5%A2%83.html
• https://www.alibabacloud.com/blog/how-to-setup-hadoop-cluster-ubuntu-16-04_593808