Condor at the IGT
Miron Livny talking at the IGT event, July 15th, 2009. The presentation of Dhruba Borthakur about Hadoop and Condor is available here .
Posts
First trials with Hadoop
I followed the Hadoop Quickstart guide and the whole process is described below. This post can be used as a reference for other people installing Hadoop. My system is OpenSuse 10.3 and Java version is 1.6.0_03. After downloading and installing the package I did the Standalone operation test : $ mkdir input $ cp conf/*.xml input $ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+' $ cat output/* Here is the output ( line feeds may be corrupted, sorry for that ): gtz2:/home/telzur/downloads/hadoop-0.14.4 # bin/hadoop jar hadoop-0.14.4-examples.jar grep input output 'dfs[a-z.]+' 08/01/05 15:47:13 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 08/01/05 15:47:13 INFO mapred.FileInputFormat: Total input paths to process : 3 08/01/05 15:47:13 INFO mapred.JobClient: Running job: job_local_1 08/01/05 15:47:13 INFO mapred.MapTask: numReduceTasks: 1 08/01/05 15:47:13 INFO mapred.LocalJobRunner: file:...