Posts

Showing posts with the label tel-zur

OpenFOAM in a container

Image
OpenFOAM up and running in 5 minutes! Get the instructions and the container from  http://openfoam.com/download/install-binary.php   MYLAPTOP> ~/Downloads/startOpenFoam+ non-network local connections being added to access control list of_v1606_plus /opt/OpenFOAM bash-4.1$ echo 'now I am inside the container' now I am inside the container bash-4.1$ cd /home/telzur/OpenFOAM/telzur-v1606+/run/cavity/cavity blockMesh icoFoam paraFoam That's it!

Ubuntu / Mint software updates problems

If you get error messages of the following kind: " E: Encountered a section with no Package: header. ..." Do the following: sudo rm /var/lib/apt/lists/* -vf sudo apt-get update It worked for me!

Supercomputing breakthroughs are correlated with the Sun activity

Image
If you want to predict major breakthroughs in Supercomputing look at the sun. It is well accepted by now that every 11 years there is a 3 orders of magnitude mile stone in supercomputers. However, about 11 years is also the cycle of the Sun activity when counting for example the number of sunspots. Surprisingly enough whenever there is a deep in the sunspots count a major supercomputing milestone takes place. The chart below says it all The Wisdom behind Small Data Mining :-) Guy

HTCondor version 8.0 Windows Installation

HTCondor version 8.0 Windows Installation from gtelzur http://www.slideshare.net/gtelzur/condor8-win-install

My Cloud Computing group have reached 4000 members

Image
You are welcome to join! https://www.facebook.com/groups/8450870046/

How to choose a Supercomputer

Image
Forget about LINPACK and FLOP/s. It is the skin that matters. The next big thing should be the "Top500 Skin" ranking. Here are my top five:       Corollaries: 1. As can be seen the US maintains its dominance. 2. All vendors can try harder. How about consulting Italian car designers? 3. SC20 should take place at the Museum of Modern Art.

My RaspberryPi

Image
RaspberryPi , a $35 toy or the next disruptive technology and a possible building block for HPC ? This credit card sized board has a ARM11 processor and 512MB RAM. The board is powered via a micro USB connector. It has two built-in USB sockets, Ethernet and HDMI video. A schematic drawing of model B which I have can be found here . I installed  Raspbian  Linux, an optimized Debian version for Raspberry, on a 4GB SD card. A cool gadget for triggering thoughts about the future of computing. Enclosed below a few pictures I took, enjoy!

The Importance of High-Performance and High-Throughput Computing in Israel

The slides of my talk at the  HPC Advisory Council Israel Supercomputing Conference 2012 that took place on February 7th, 2012 at Tel-Aviv university are available from here . The Importance of High-Performance and High-Throughput Computing in Israel

Virtual Cluster using VirtualBox

Image
I tested the new HPC Europa Milestone 6 DVD and created a virtual cluster using VirtualBox on my laptop. I created a head-node and two computing nodes connected via a VLAN.  The head node has two network interfaces, NAT which enables the connection to the outside world and an internal virtual interface. The two computing nodes have only one network interface each for the VLAN. In picture number 1 the VirtualBox dashboard is shown with the 3 running computers Picture number 1: The VirtualBox dashboard showing the 3 running computers of the virtual cluster Picture number 2: The desktop of the head node (left) and the two computing nodes (right) In picture number two a PBS job executing a simple MPI task is demonstrated. The head node is on the left and the two computing nodes are on the right. My general impression is that this Virtual Cluster is an excellent tool for education where the teacher and later on the students can experience Parallel Processing using the...

Globus Provision

Image
I tested globus-provision which is an easy way to have a globus+condor cluster ready for number crunching on Amazon’s EC2 cloud. My front end was my laptop which runs Windows. Python on Windows does not behave exactly as on Linux when it comes to SIGINT and therefore os.fork() generated an error message. Thanks to the support of  Borja Sotomayor the SIGINT issues has resolved and the solution was to by-pass the SIGINT so I could proceed with the test. You can read more about this issue from here: http://jira.globus.org/browse/GP-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel I tried the example from: http://globus.org/provision/guide_compute_go.html#guide-compute-go I decided not to use globusonline for the eBooks transfer and I used wget instead. Below are a few screen captures that show the test. My configuration file:  Preparing the instance: after a minute or two: checking the instance: Watching my cluster at the AWS management ...

"Big Data" - The New Big Kid in Town

Image
A year ago almost no one knew this term. With a doubling time of less than 6 months "Big Data" is becoming a hot hype, as can be seen below (by  Google Trends ) :

The End of Supercomputers As We Know Them Today

About four years ago I predicted in this blog the fall of Grid Computing and the rise of Cloud Computing (  http://telzur.blogspot.com/2007/10/end-of-grid-computing.html  ) Now I want to claim that Supercomputers as we know them today will not be the kind we will see in the future. I think that within a couple of years: 1. Most supercomputers will shift to the cloud (HPC Cloud). 2. The governance of X86 is not guaranteed: We already see the rise of GPGPUs and we will see more families of technologies being involved, e.g. Tegra and ARM, Reconfigureable Computing (RC) i.e. FPGAs, etc'. 3. Supercomputers won't be anymore General Purpose machines. They will be reconstructed as a Cloud Service ( Supercomputing as a Service ) from all the available technologies (see previous section) per single mission (program) in order to maximize the performance and minimize the consumed energy and cost. I decided to use the word mission because the word  task is u...

Cloud Computing turns 15!

Congratulations! Cloud Computing turns 15, don't believe? check this link. The original article is by Technology Review , check here

Computational Science and Engineering

You are welcome to join my Meetup group about Computational Science and Engineering  (we are the leftmost site but the exact location is not exactly as appears on the map :-( )

HPC DAY & LINKSCEEM USER MEETING

Image
http://www.cs.bgu.ac.il/~frankel/HPCDay/program.html

The Chernobyl accident of Cloud Computing

    When introducing Cloud Computing (CC) people usually like to emphasize the similarities between Electric Power Grids (EPG) and CC.     These analogies include: On demand service, Pay-Per-Use (PPU) model, the Elasticity of the resources, load balancing and even water cooling,     After the Amazon EC2 service disruption on April 21 st , 2011, we can identify more similarities between EPG and CC in disasters related issues. These similarities include: 1. A global damage (with immediate and delayed components). 2. Uncontrolled behavior of the resources (neutron population vs. loss of connectivity or fuel rods meltdown vs. failing servers). 3. During the crisis, similar announcements to the public which minimize the catastrophe. 4. After the crisis, publication of the event investigation in length. 5. Loss of confidence in the technology by the users.

Supercomputing trends: Peta mug vs.Tera mug

Image

IGT HPC Work Group Meeting

Image
When: Wednesday, November 24 rd , 2010 Where: IGT Offices, Maskit 4, 5th Floor, Hertzliya. 13:45-14:00: Gathering 14:00-14:10: Opening - Avner & Guy 14:10-15:00: Geomage GPU Cluster - Case Study 15:00-15:15: Coffee Break 15:15-16:00: Impressions from Super Computing 2010 Conference 16:00-16:10: Discussion and concluding remarks Detailed Agenda: 14:10-15:00:   Geomage GPU Cluster - Case Study Speaker: Eyal Hirsch, Senior HPC developer , Geomage Abstract Geomage has been using Tesla line GPUs in production for the last 2 years. The cluster operates at high volumes, in terms of computation power, processing seismic projects around the clock. Presentation will talk about seismic processing and the issues we've encountered from the development stage, QA, multi-GPU all the way to production including a real world case study. 15:00-15:15: Coffee Break 15:15-16:00: Impressions from Super Computing 2010 Conference Speaker: Dr. Guy Tel-Zur – IGT Chairman. Abstract The ...

Nvidia Nsight Installation Failed

Image
I have a Windows 7 (64bits) OS with Visual Studio 2008 with SP1. After starting  Parallel_Nsight_Host_Win64_1.0.10200 (Jul 2010) I got the following error message: “ The required version of Visual Studio (2008 SP1) was not detected ” – see screen capture: I guess the problem is in the system registry of VS2008 which partly located  as a 32bit system and partly as a 64bit system and Nsight didn’t find what it expected.  SP1 seems to be installed as can be seen in the image below:   It turned out that although SP1 is installed, it was not installed correctly. After trying to reinstall SP1 I got the following error message: I checked the log file:   Exe (C:\Users\telzur\AppData\Local\Temp\Microsoft Visual Studio 2008 SP1\VC_x86Runtime.exe) succeeded. [8/6/2010, 18:34:11] (IronSpigot::ExeInstallerBase::PerformAction) Log File: dd_VC_x86RuntimeMSI18CE.txt [8/6/2010, 18:34:11] (IronSpigot::ExeInstallerBase::PerformAction) Log File: dd_VC_x86RuntimeUI18CE.tx...

Sharing USB disk with Virtual Box guest OS

Assuming the host OS is Windows and the guest OS is Linux (CentOS in my case): make a directory at the guest OS for the flash storage: mkdir /home/telzur/shared Plug the memory stick and check the guest OS log: tail /var/log/messages find the name of the new device, in my case, ./dev/sdb1 as root: mount –t vfat /dev/sdb1 /home/telzur/shared Your files are now in the shared folder. Enjoy!