728x90

목록분류 전체보기 (661)

DBILITY

hadoop job control

순차적으로 실행 JobConf job1=new JobConf(getConf()); ... JobClient.run(job1); JobConf job2=new JobConf(getConf()); ... JobClient.run(job2); JobConf job3=new JobConf(getConf()); ... JobClient.run(job3); 의존관계의 연결 JobConf job1=new JobConf(getConf()); ... JobConf job2=new JobConf(getConf()); ... JobConf job3=new JobConf(getConf()); ... JobConf job4=new JobConf(getConf()); ... JobControl con=new JobControl(..
bigdata/hadoop 2017. 4. 16. 12:17
hadoop 2.6.4 window 10 pseudo distribution mode 설치

hadoop 2.6.4 binary 다운로드 http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.6.4/hadoop-2.6.4.tar.gz winutils 다운로드 https://github.com/steveloughran/winutils eclipse hadoop 2.x plugin 다운로드 https://github.com/winghc/hadoop2x-eclipse-plugin eclipse > dorpins에 hadoop-eclipse-plugin-2.6.0.jar 복사 HADOOP_HOME 환경변수 설정 ( E:/hadoop-2.6.4 ) hadoop-2.6.4.tar.gz 압축해제 후 %HADOOP_HOME% 에 복사 winutils-mas..
bigdata/hadoop 2017. 4. 1. 09:33
gitblit

http://gitblit.com/
reference 2017. 3. 28. 14:10
Fork and Join: Java Can Excel at Painless Parallel Programming Too

http://www.oracle.com/technetwork/articles/java/fork-join-422606.html 나는 그동안 무엇을 하고 있었나하고 생각하게 만드는 예제입니다^^;
reference 2017. 3. 28. 13:08
hadoop 2.x winutils

https://github.com/steveloughran/winutils GitHub - steveloughran/winutils: Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase) Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase) - GitHub - steveloughran/winutils: Windows binaries for Hadoop versions (built from the git commit ID use... github.com 어떻게 했었는지 기억이 안남..
bigdata/hadoop 2017. 3. 27. 12:42
Prev 1 ··· 105 106 107 108 109 110 111 ··· 133 Next
728x90