using Hadoop to Cassandra through Binary Memtable
作者:anotherbug 日期:2010-01-30
http://github.com/lenn0x/Cassandra-Hadoop-BMT/blob/master/src/java/org/digg/CassandraBulkLoader.java
[code]
/*
* Copyright (c) 2009, Chris Goffinet
*
* Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "...
[code]
/*
* Copyright (c) 2009, Chris Goffinet
*
* Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "...
hadoop安装
作者:anotherbug 日期:2008-03-16
 |
 |
 |
 |
1.解压
CODE:
tar -zvxf hadoop-0.16.1.tar.gz
同时设置环境变量
[code]
# vi /etc/profile
JAVA_HOME=/usr/local/jrockit
export JAVA_HOME
PATH=$PATH:$JAVA_HOME/bin
export PATH
CLASSPATH=.:$JAVA_HOME/lib:$JAVA_HOME/jre/lib
export CLASSPATH
HADOOP_HOME=/usr/local/hadoop
export HADOOP_HOME...
The Hadoop Distributed File System: Architecture
作者:anotherbug 日期:2008-03-03
 |
 |
Hardware Failure
Hardware failure is the norm rather than the exception. An HDFS instance may consist of hundreds or thousands of server machines, each storing part of the file system’s data. The fact that there are a huge number of components and that each component has a non-trivial probability ...
Hbase Test Example
作者:anotherbug 日期:2007-08-02
1. hadoop start
2. hbase start
(HMaster, HRegionServer)
org.apache.hadoop.hbase.HMaster start
org.apache.hadoop.hbase.HRegionServer start
3. Table create
java org.apache.hadoop.hbase.HClient createTable webtable contents: anchors: 10
4. run Test program:
[code]
public class H...
2. hbase start
(HMaster, HRegionServer)
org.apache.hadoop.hbase.HMaster start
org.apache.hadoop.hbase.HRegionServer start
3. Table create
java org.apache.hadoop.hbase.HClient createTable webtable contents: anchors: 10
4. run Test program:
[code]
public class H...
Hadoop implements MapReduce
作者:anotherbug 日期:2007-08-02
 |
Here's what makes Hadoop especially useful:
Scalable: Hadoop can reliably store and process petabytes.
Economical: It distributes the data and processing across clusters of commonly available computers. These clusters can number into the thousands of nodes.
Efficient: By distributing the data...
用Hadoop搭建分布式存储和分布式运算集群
作者:anotherbug 日期:2007-05-26
用Hadoop搭建分布式存储和分布式运算集群
Filed under: 搜索, 配置, 开发 — 钟 子昌 @ 7:59 pm
1. 列出使用的机器
普通PC，要求：
cpu: 750M-1G
mem: >128M
disk: >10G
不需要太昂贵的机器。
机器名：
finewine01
finewine02
finewine03
将finewine01设为主节点，其它的机器为从节点。
2. 下载和生成
从这里checkout，我选择trunk
http://svn.apache.org/repos/asf/lucene/had...
Filed under: 搜索, 配置, 开发 — 钟 子昌 @ 7:59 pm
1. 列出使用的机器
普通PC，要求：
cpu: 750M-1G
mem: >128M
disk: >10G
不需要太昂贵的机器。
机器名：
finewine01
finewine02
finewine03
将finewine01设为主节点，其它的机器为从节点。
2. 下载和生成
从这里checkout，我选择trunk
http://svn.apache.org/repos/asf/lucene/had...
标签: hadoop
