Guy Tel-Zur's Blog

The 4th Grid-HPC Work group meeting Date: Thursday, November 9th Location: IGT Offices, Maskit 4, 5th Floor, Hertzliya Agenda: 14:00 - 14:15: Opening. Avner & Guy 14:15 - 15:00: Grid Mathematica. Speaker: Haim Ricas, M.Sc Applied Mathematica General Manager Tashtit Scientific Consultants Ltd Wolfram Research Distributors in Israel Abstract: gridMathematica implements many parallel programming primitives and includes high-level commands for parallel execution of matrix operations, plotting, and other functions. It comes with sample applications of many popular new programming approaches, such as parallel Monte Carlo simulation, visualization, searching, and optimization. The implementations for all high-level parallel processing commands are provided in Mathematica source form, so they can also serve as templates for users to build their own parallel programs. At the meeting I'll present a general overview, I'll demonstrate powerful...

I just installed Fedora Core 6. The WiFi was not detected (once again :( ). Here are the steps to overcome this problem: 1) Find the type of card installed on your laptop by lspci -v : 0c:00.0 Network controller: Broadcom Corporation Dell Wireless 1390 WLAN Mini-PCI Card (rev 01) Subsystem: Dell Unknown device 0007 Flags: bus master, fast devsel, latency 0, IRQ 177 Memory at dfdfc000 (32-bit, non-prefetchable) [size=16K] Capabilities: [40] Power Management version 2 Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/0 Enable- Capabilities: [d0] Express Legacy Endpoint IRQ 0 Capabilities: [100] Advanced Error Reporting Capabilities: [13c] Virtual Channel 2) Download and install the latest ndiswrapper (ndiswrapper-1.27.tar in my case) # cd ndiswrapper-1.27 # make uninstall # make # make install # lspci -n [root@localhost DRIVER]# ndiswrapper -h install/manage Windows drivers for ndiswrapper usage: ndiswrapper OPTION -i inffile install driver described by ...

I installed CentOS 4.4 and was surprised to find out that the wireless connection was not working. After some Internet searching I did the follwing two steps which solved the problem: 1) Installed the IPW2200 firmware 2) Installed the WiFi Radar Enclosed are screen shots that summerise all the ingredients and the successful happy end

The recepie below may not be the simplest but this is what I had discovered while learning this subject From the browser which holds your certificate make a bakup that will save it in p12 format. If you are working under Windows, this is the right moment to FTP it to Linux where life are easier, then proceed from you Linux computer by converting the *.p12 certificate to *.pem format: openssl pkcs12 -info -in guy_cert_iucc_expired.p12 -out ~/.globus/usercert.pem (don't forget BTW to chmod 644 this file) then, extract the DN by: /usr/local/globus-4.0.2/bin/grid-cert-info -subject in my case the result will be: /C=IL/O=IUCC/CN=IUCC/emailAddress=ca@mail.iucc.ac.il which is my DN actually you can simply grep the string subject from usercert.pem Good luck

The following work was done on "titan": [ globus@titan globus-4.0.2]$ export GLOBUS_LOCATION=/usr/local/globus-4.0.2 [globus@titan globus-4.0.2]$ $GLOBUS_LOCATION/setup/globus/setup-simple-ca WARNING: GPT_LOCATION not set, assuming: GPT_LOCATION=/usr/local/globus-4.0.2 C e r t i f i c a t e A u t h o r i t y S e t u p This script will setup a Certificate Authority for signing Globus users certificates. It will also generate a simple CA package that can be distributed to the users of the CA. The CA information about the certificates it distributes will be kept in: /home/globus/.globus/simpleCA/ ERROR: It looks like a CA has already been setup at this location. Do you want to overwrite this CA? (y/n) [n]: y The unique subject name for this CA is: cn=Globus Simple CA, ou=simpleCA-titan, ou=GlobusTest, o=Grid Do you want to keep this as the CA subject (y/n) [y]: Enter the email of the CA (this is the email where certificate requests will be sent to...

cd to: /home/condor/MonaLisa/Service/CMD then type: [condor@grid4 CMD]$ ./MLD start Password: Starting UPDATE ..........OK Trying to start MonaLisa.Please wait...STARTED [ PID == 4427 ] or better, as root: Usage: /etc/rc.d/init.d/MLD [start|stop|restart] Then enjoy the plot from the client:

We wanted to do some benchmarks about file transfers between Israel and Singapore. Here is my way to create a big file, using Octave (Matlab should work as well): -bash-2.05b$ cat ./big.m mat=ones(1,1000*1024*1024/8); size(mat) save -binary OneGig.dat mat # here are a few examples: -bash-2.05b$ ls -l -rw-r--r-- 1 tel-zur tel-zur 1000M Jun 23 18:19 OneGig.dat You are welcome to try, but hey! Give me a credit ok ? :) Here is an update to this post (Nov.16,2006): The method above can be called the " Physicist Way ", Now I will describe the " Computer Geek Way ", which is much more elegant of course: dd if=/dev/zero of=one_gig_file bs=1M count=1000 That's it!

The 3rd IGT HPC work group meeting will take place on Wednesday, June 21, 15:00-17:00 For further details click on the link or visit the IGT web site then click on "Next IGT Events"

Using VPN I can now do lots of things as if I am connected from inside the campus: Bingo! I am connected and able to submit Condor jobs from the departmental terminal server and of course browes magazines from the university library.

The DDT is now installed on the grid nodes and works fine! Here is a screenshot of my first test run: This test was performed using OpenMPI v1.0.2.

Ganglia is now installed on my Linux nodes at home. You can see it live by visiting my website tel-zur.org . A screenshot is on the left. In two of the nodes (FC 5 and Scientific Linux) installing the gmond rpm was enough, but on the 3rd node (SuSE10) I had to compile the source.

Follow these steps: 1) ~ mkdir .ssh 2) cd .ssh 3) ssh-keygen -t dsa % no passphrase, just press twice 4) cat id_dsa.pub >> authorized_keys2 5) Repeat step #4 for all the public keys of the desired nodes. 6) chmod 600 ./authorized_keys2 * Enjoy

Testing the network connection between the BGU and my new collaborators in Singapore

Condor version and platform: $CondorVersion: 6.6.10 Jun 13 2005 $ $CondorPlatform: I386-LINUX_RH9 $ Condor is now instaled on Grid4,5,6,7 and 9. All the nodes are both compute and submit nodes, Grid9 is the Central Manager. Grid8 is down due to a hard disk failure. [condor@grid4 condor]$ condor_status Name OpSys Arch State Activity LoadAv Mem ActvtyTime vm1@grid4.bgu LINUX INTEL Owner Idle 0.000 501[?????] vm2@grid4.bgu LINUX INTEL Unclaimed Idle 0.000 501 0+00:39:33 vm1@grid5.bgu LINUX INTEL Owner Idle 0.000 249[?????] vm2@grid5.bgu LINUX INTEL Owner Idle 0.000 249[?????] vm1@grid6.bgu LINUX INTEL Owner Idle 0.000 501[?????] vm2@grid6.bgu LINUX INTEL Owner Idle 0.000 501[?????] vm1@grid7.bgu LINUX INTEL Owner Idle 0.000 501[?????] vm2@grid7.bgu LINUX INTEL Owner Idle 0.000 501[?????] vm1@grid9.bgu LINUX ...

Grid4: Processor: Dual AMD Athlon(tm) MP 2000+, 1666MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux 3.03, Kernel: 2.4.21-20.ELsmp Grid5: Processor: Intel(R) Pentium(R) 4 CPU 3.00GHz, cache: 1MB, HD:80GB, OS: Scientific Linux, Kernel 2.4.21-37.ELsmp. Grid6: Processor: Dual AMD Athlon(tm) MP 1900+, 1600MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux, Kernel: 2.4.21-20.ELsmp Grid7: Processor: Dual AMD Athlon(tm) MP 2000+, 1666MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux 3.03, Kernel: 2.4.21-20.ELsmp Grid8: Down!!! Grid9: Dual AMD Athlon(tm) MP 2000+, 1666MHz, cache: 256 KB, RAM: 1GB, HD: 40GB, OS: Scientific Linux 3.03, Kernel: 2.4.21-20.ELsmp

Collaboration with Chen Keasar In the forthcoming weeks I will try to "Condorize" his computer code Meshi

Welcome to my Grid Computing and other stuff blog! Your comments will be most appreciated. Today's activities 1) Set ssh access without password between nodes. 2) Install Condor 6.6.10 on grid8.bgu.ac.il being the central manager: under /usr/local [root@grid8 local]# gzip -d condor-6.6.10-linux-x86-glibc23-dynamic.tar.gz [root@grid8 local]# tar xvf ./condor-6.6.10-linux-x86-glibc23-dynamic.tar [root@grid8 local]# hostname grid8.bgu.ac.il [root@grid8 local]# cd condor-6.6.10 [root@grid8 condor-6.6.10]# ./condor_install My answer to the Condor installer: Full installation. Multiple machines. Machines do not share files via a file server. There is no realse dir yet. Installation dir: /usr/local/condor Create that directory. Notify by Email to: tel-zur@ee.bgu.ac.il Mail path: /bin/mail Do all the machines are from domain " bgu.ac.il " - Yes. Unique UID - No. Enable Java support: Yes Java exists under: /usr/bin/java Create links to other directories: Yes "bin" wi...