Posts

Showing posts from 2006

The 4th IGT Grid-HPC Work group meeting

The 4th Grid-HPC Work group meetingDate: Thursday, November 9thLocation: IGT Offices, Maskit 4, 5th Floor, HertzliyaAgenda:14:00 - 14:15: Opening. Avner & Guy14:15 - 15:00: Grid Mathematica. Speaker: Haim Ricas, M.Sc Applied MathematicaGeneral Manager Tashtit Scientific Consultants LtdWolfram Research Distributors in IsraelAbstract: gridMathematica implements many parallel programming primitives and includes high-level commands for parallel execution of matrix operations, plotting, and other functions. It comes with sample applications of many popular new programming approaches, such as parallel Monte Carlo simulation, visualization, searching, and optimization. The implementations for all high-level parallel processing commands are provided in Mathematica source form, so they can also serve as templates for users to build their own parallel programs.At the meeting I'll present a general overview, I'll demonstrate powerful examples and I'll discuss main k…

Installing WiFi on my DELL Latitude 420 running Fedora Core 6

Image
I just installed Fedora Core 6. The WiFi was not detected (once again :( ).
Here are the steps to overcome this problem:

1) Find the type of card installed on your laptop by lspci -v:
0c:00.0 Network controller: Broadcom Corporation Dell Wireless 1390 WLAN Mini-PCI Card (rev 01)

Subsystem: Dell Unknown device 0007
Flags: bus master, fast devsel, latency 0, IRQ 177
Memory at dfdfc000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [40] Power Management version 2
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/0 Enable-
Capabilities: [d0] Express Legacy Endpoint IRQ 0
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Virtual Channel

2) Download and install the latest ndiswrapper (ndiswrapper-1.27.tar in my case)

# cd ndiswrapper-1.27
# make uninstall
# make
# make install
# lspci -n
[root@localhost DRIVER]# ndiswrapper -h
install/manage Windows drivers for ndiswrapper
usage: ndiswrapper OPTION
-i inffile install driver described by 'inffile'
-a devid driver u…

Installing WiFi on my ThinkPad

Image
I installed CentOS 4.4 and was surprised to find out that the wireless connection was not working.
After some Internet searching I did the follwing two steps which solved the problem:
1) Installed the IPW2200 firmware
2) Installed the WiFi Radar
Enclosed are screen shots that summerise all the ingredients and the successful happy end


How to extract your DN (Distinguished Name) from your certificate

The recepie below may not be the simplest but this is what I had discovered while learning this subject

From the browser which holds your certificate make a bakup that will save it in p12 format.
If you are working under Windows, this is the right moment to FTP it to
Linux where life are easier, then proceed from you Linux computer by converting the *.p12 certificate to *.pem format:

openssl pkcs12 -info -in guy_cert_iucc_expired.p12 -out ~/.globus/usercert.pem

(don't forget BTW to chmod 644 this file)

then, extract the DN by:

/usr/local/globus-4.0.2/bin/grid-cert-info -subject

in my case the result will be:

/C=IL/O=IUCC/CN=IUCC/emailAddress=ca@mail.iucc.ac.il

which is my DN

actually you can simply grep the string subject from usercert.pem

Good luck

Today I want to document setting a CA for my Globus project

The following work was done on "titan":


[globus@titan globus-4.0.2]$ export GLOBUS_LOCATION=/usr/local/globus-4.0.2
[globus@titan globus-4.0.2]$ $GLOBUS_LOCATION/setup/globus/setup-simple-ca

WARNING: GPT_LOCATION not set, assuming:
GPT_LOCATION=/usr/local/globus-4.0.2



C e r t i f i c a t e A u t h o r i t y S e t u p

This script will setup a Certificate Authority for signing Globus
users certificates. It will also generate a simple CA package
that can be distributed to the users of the CA.

The CA information about the certificates it distributes will
be kept in:

/home/globus/.globus/simpleCA/

ERROR: It looks like a CA has already been setup at this location.
Do you want to overwrite this CA? (y/n) [n]:y

The unique subject name for this CA is:

cn=Globus Simple CA, ou=simpleCA-titan, ou=GlobusTest, o=Grid

Do you want to keep this as the CA subject (y/n) [y]:

Enter the email of the CA (this is the email where certificate
requests will be sent to be signed by the CA):tel-zur@c…

How to start MonALISA - A reminder for myself

Image
cd to: /home/condor/MonaLisa/Service/CMD
then type:
[condor@grid4 CMD]$ ./MLD start
Password:
Starting UPDATE
..........OK
Trying to start MonaLisa.Please wait...STARTED [ PID == 4427 ]

or better, as root:
Usage: /etc/rc.d/init.d/MLD [start|stop|restart]

Then enjoy the plot from the client:

How to create a big file?

We wanted to do some benchmarks about file transfers between Israel and Singapore.
Here is my way to create a big file, using Octave (Matlab should work as well):

-bash-2.05b$ cat ./big.m
mat=ones(1,1000*1024*1024/8);
size(mat)
save -binary OneGig.dat mat

# here are a few examples:

-bash-2.05b$ ls -l
-rw-r--r-- 1 tel-zur tel-zur 1000M Jun 23 18:19 OneGig.dat

You are welcome to try, but hey! Give me a credit ok ? :)

Here is an update to this post (Nov.16,2006):
The method above can be called the "Physicist Way", Now I will describe the "Computer Geek Way", which is much more elegant of course:

dd if=/dev/zero of=one_gig_file bs=1M count=1000

That's it!

The 3rd IGT HPC work group meeting

The 3rd IGT HPC work group meeting will take place on Wednesday, June 21, 15:00-17:00
For further details click on the link or visit the IGT web site then click on "Next IGT Events"

The wonderful VPN

Image
Using VPN I can now do lots of things as if I am connected from inside the campus:


Bingo! I am connected and able to submit Condor jobs from the departmental terminal server and of course browes magazines from the university library.




Distributed Debugger Tool

Image
The DDT is now installed on the grid nodes and works fine!
Here is a screenshot of my first test run:This test was performed using OpenMPI v1.0.2.

Ganglia @ home

Image
Ganglia is now installed on my Linux nodes at home.
You can see it live by visiting my website tel-zur.org.
A screenshot is on the left. In two of the nodes (FC 5 and Scientific Linux) installing the gmond rpm was enough, but on the 3rd node (SuSE10) I had to compile the source.

Password-less ssh connection

Follow these steps:
1) ~ mkdir .ssh
2) cd .ssh
3) ssh-keygen -t dsa % no passphrase, just press twice
4) cat id_dsa.pub >> authorized_keys2
5) Repeat step #4 for all the public keys of the desired nodes.
6) chmod 600 ./authorized_keys2
* Enjoy
Image
Testing the network connection between the BGU and my new collaborators in Singapore

Condor is now installed on the Grid nodes

Condor version and platform:
$CondorVersion: 6.6.10 Jun 13 2005 $
$CondorPlatform: I386-LINUX_RH9 $

Condor is now instaled on Grid4,5,6,7 and 9. All the nodes are both compute and submit nodes, Grid9 is the Central Manager.
Grid8 is down due to a hard disk failure.

[condor@grid4 condor]$ condor_status

Name OpSys Arch State Activity LoadAv Mem ActvtyTime

vm1@grid4.bgu LINUX INTEL Owner Idle 0.000 501[?????]
vm2@grid4.bgu LINUX INTEL Unclaimed Idle 0.000 501 0+00:39:33
vm1@grid5.bgu LINUX INTEL Owner Idle 0.000 249[?????]
vm2@grid5.bgu LINUX INTEL Owner Idle 0.000 249[?????]
vm1@grid6.bgu LINUX INTEL Owner Idle 0.000 501[?????]
vm2@grid6.bgu LINUX INTEL Owner Idle 0.000 501[?????]
vm1@grid7.bgu LINUX INTEL Owner Idle 0.000 501[?????]
vm2@grid7.bgu LINUX INTEL Owner Idle 0.000 501[?????]
vm1@grid9.bgu LINUX INTEL Ow…

The Grid computers specifications

Grid4: Processor: Dual AMD Athlon(tm) MP 2000+, 1666MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux 3.03, Kernel: 2.4.21-20.ELsmp

Grid5: Processor: Intel(R) Pentium(R) 4 CPU 3.00GHz, cache: 1MB, HD:80GB, OS: Scientific Linux, Kernel 2.4.21-37.ELsmp.

Grid6: Processor: Dual AMD Athlon(tm) MP 1900+, 1600MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux, Kernel: 2.4.21-20.ELsmp

Grid7: Processor: Dual AMD Athlon(tm) MP 2000+, 1666MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux 3.03, Kernel: 2.4.21-20.ELsmp

Grid8: Down!!!

Grid9: Dual AMD Athlon(tm) MP 2000+, 1666MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux 3.03, Kernel: 2.4.21-20.ELsmp

A New Condor Application at the BGU

Collaboration with Chen Keasar
In the forthcoming weeks I will try to "Condorize" his computer code Meshi

BGU grid computers maintenance

Welcome to my Grid Computing and other stuff blog!
Your comments will be most appreciated.

Today's activities
1) Set ssh access without password between nodes.
2) Install Condor 6.6.10 on grid8.bgu.ac.il being the central manager:
under /usr/local
[root@grid8 local]# gzip -d condor-6.6.10-linux-x86-glibc23-dynamic.tar.gz
[root@grid8 local]# tar xvf ./condor-6.6.10-linux-x86-glibc23-dynamic.tar
[root@grid8 local]# hostname grid8.bgu.ac.il
[root@grid8 local]# cd condor-6.6.10
[root@grid8 condor-6.6.10]# ./condor_install
My answer to the Condor installer:
Full installation.
Multiple machines.
Machines do not share files via a file server.
There is no realse dir yet.
Installation dir: /usr/local/condor
Create that directory.
Notify by Email to: tel-zur@ee.bgu.ac.il
Mail path: /bin/mail
Do all the machines are from domain "bgu.ac.il" - Yes.
Unique UID - No.
Enable Java support: Yes
Java exists under: /usr/bin/java
Create links to other directories: Yes
"bin" will go to /usr/local/bin
Full…