Hi, I'm an architecture engineer and native Korean speaker.
I have started to live in Seoul in Korea.
I have been developping Abilists tool,
Please feel free to visit abilists.com
Tuesday, July 23, 2013
Hbase - Important thing
# When you execute a client App on Tomcat, If you faced the following the error,
→Will not attempt to authenticate using SASL (unknown error)
# You add host's name in the hosts file. this is sample.
17x.2x.xxx.xx1 master01
17x.2x.xxx.xx2 slave02
17x.2x.xxx.xx3 slave03
17x.2x.xxx.xx4 slave04
# A client App(Hbase) on Tomcat is related with all of hbase server host name.
Friday, July 19, 2013
Hadoop - exclude a node on ruuning server
■dfs.hosts.exclude:
Names a file that contains a list of hosts that are not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded.
# Add below this to hdfs-site.xml
<property>
<name>dfs.hosts.exclude</name>
<value>/home/hadoop/hadoop/conf/excludes</value>
</property>
■mapred.hosts.exclude
Names a file that contains the list of hosts that should be excluded by the jobtracker. If the value is empty, no hosts are excluded. # Add below this to mapred-site.xml
<property>
<name>mapred.hosts.exclude</name>
<value>/home/hadoop/hadoop/conf/excludes</value>
</property>
# Excute
$ bin/hadoop dfsadmin -refreshNodes
# Excute Banlancer to banlanc for data
bin/hadoop balancer
Names a file that contains a list of hosts that are not permitted to connect to the namenode. The full pathname of the file must be specified. If the value is empty, no hosts are excluded.
# Add below this to hdfs-site.xml
<property>
<name>dfs.hosts.exclude</name>
<value>/home/hadoop/hadoop/conf/excludes</value>
</property>
■mapred.hosts.exclude
Names a file that contains the list of hosts that should be excluded by the jobtracker. If the value is empty, no hosts are excluded. # Add below this to mapred-site.xml
<property>
<name>mapred.hosts.exclude</name>
<value>/home/hadoop/hadoop/conf/excludes</value>
</property>
# Excute
$ bin/hadoop dfsadmin -refreshNodes
# Excute Banlancer to banlanc for data
bin/hadoop balancer
Thursday, July 18, 2013
Hbase - Connection Pool
-------------------------------------------------------------------------
# You need to set ips in the hosts file.
<hbase>
<master>server1:6000</master>
<zookeeper>
<quorum>server1</quorum>
<property>
<clientPort>2181</clientPort>
</property>
</zookeeper>
</hbase>
Flume - flume-env.sh
JAVA_HOME=/usr/local/java
FLUME_CLASSPATH="/home/hadoop/flume/lib"
FLUME_CLASSPATH="/home/hadoop/flume/lib"
Wednesday, July 17, 2013
Git - Push to remote And Delete a branch
# Push origin branch, not upstream
$ git push orign service_branch
@ Delete a local branch, on the master branch.
$ git branch -d branch_name
@ If you get a error like this, but if you change the branch to master, and then
@ commend git branch -d branch_name on the prompt.
@---------------------------------------------------
@error: The branch 'branch_name' is not fully merged.
@If you are sure you want to delete it, run 'git branch -D branch_name'.
@---------------------------------------------------
$ git branch -D dev
@ Delete a remote branch
$ git push origin --delete dev
@ Make a branch in Local
$ git checkout -b branch_name
@ Make a branch in Remote
$ git push origin branch_name
@ You can not delete branches showing list
git branch --no-merged
$ git push orign service_branch
@ Delete a local branch, on the master branch.
$ git branch -d branch_name
@ If you get a error like this, but if you change the branch to master, and then
@ commend git branch -d branch_name on the prompt.
@---------------------------------------------------
@error: The branch 'branch_name' is not fully merged.
@If you are sure you want to delete it, run 'git branch -D branch_name'.
@---------------------------------------------------
$ git branch -D dev
@ Delete a remote branch
$ git push origin --delete dev
@ Make a branch in Local
$ git checkout -b branch_name
@ Make a branch in Remote
$ git push origin branch_name
@ You can not delete branches showing list
git branch --no-merged
Thursday, July 11, 2013
Troubleshooting - hadoop
# ipc.Client: Retrying connect to server: localhost/127.0.0.1:9000.
# You'd better check your hosts file
http://gh0stsp1der.tistory.com/66
# Hbase
#Unable to find region for 99999999999999 after 10 tries
http://nosql.rishabhagrawal.com/2013/04/hbase-orgapachehadoophbaseclientnoserve.html
# You'd better check your hosts file
http://gh0stsp1der.tistory.com/66
# Hbase
#Unable to find region for 99999999999999 after 10 tries
http://nosql.rishabhagrawal.com/2013/04/hbase-orgapachehadoophbaseclientnoserve.html
Monday, July 8, 2013
Spring - Spring3 connect to Mybatis on spring-mybatis.
// A part of ServiceImpl.javaList<HadoopGameModel> hadoopGameList = slaveAdminDao.getMapper(SlaveDao.class).selectGameList(mapSelectGameList);
Git - Let's Fork the project
$ #Fork the "project-name" repository
$ git clone git@github.com:njoon/project-name.git
$ cd project-name/
$ git remote add upstream git@github.com:organizations/project-name.git
$ git fetch upstream
@If you want to remove the upstream
$ git remote remove upstream
----------------------------------------------------------------------------------------------
# If you want to merge from original branch(not forked master)
$ git fetch upstream
# To merge its changes into our local branch.
$ git branch -va
$ git checkout master
$ git merge upstream/master
# And you'd better use the Pull Request.
https://help.github.com/articles/syncing-a-fork
$ git clone git@github.com:njoon/project-name.git
$ cd project-name/
$ git remote add upstream git@github.com:organizations/project-name.git
$ git fetch upstream
@If you want to remove the upstream
$ git remote remove upstream
----------------------------------------------------------------------------------------------
# If you want to merge from original branch(not forked master)
$ git fetch upstream
# To merge its changes into our local branch.
$ git branch -va
$ git checkout master
$ git merge upstream/master
# And you'd better use the Pull Request.
https://help.github.com/articles/syncing-a-fork
Subscribe to:
Posts (Atom)