Guy Tel-Zur's Blog

HTCondor version 8.0 Windows Installation from gtelzur http://www.slideshare.net/gtelzur/condor8-win-install

You are welcome to join! https://www.facebook.com/groups/8450870046/

I tested globus-provision which is an easy way to have a globus+condor cluster ready for number crunching on Amazon’s EC2 cloud. My front end was my laptop which runs Windows. Python on Windows does not behave exactly as on Linux when it comes to SIGINT and therefore os.fork() generated an error message. Thanks to the support of  Borja Sotomayor the SIGINT issues has resolved and the solution was to by-pass the SIGINT so I could proceed with the test. You can read more about this issue from here: http://jira.globus.org/browse/GP-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel I tried the example from: http://globus.org/provision/guide_compute_go.html#guide-compute-go I decided not to use globusonline for the eBooks transfer and I used wget instead. Below are a few screen captures that show the test. My configuration file:  Preparing the instance: after a minute or two: checking the instance: Watching my cluster at the AWS management ...

Congratulations! Cloud Computing turns 15, don't believe? check this link. The original article is by Technology Review , check here

DotCloud claims to be One Platform - Any Stack Cloud solution I decided to test it myself, read below. 1. Registration Very easy and quick! 2. Setup I used a Linux desktop (dream linux). I needed to install first Python´s ¨easy-install¨ which was missing.  2.1 Installing easy_install sudo apt-get update sudo apt-get install python-setuptools 2.2 Dotcloud API installation t elzur@dream:~/Downloads/dotcloud$ sudo easy_install pip && sudo pip install dotcloud Searching for pip Reading http://pypi.python.org/simple/pip/ Reading http://www.pip-installer.org Reading http://pip.openplans.org Best match: pip 1.0.1 Downloading http://pypi.python.org/packages/source/p/pip/pip-1.0.1.tar.gz#md5=28dcc70225e5bf925532abc5b087a94b Processing pip-1.0.1.tar.gz Running pip-1.0.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-XXryzJ/pip-1.0.1/egg-dist-tmp-f2uO_w warning: no files found matching '*.html' under directory 'docs' warning: no previously-inclu...

    When introducing Cloud Computing (CC) people usually like to emphasize the similarities between Electric Power Grids (EPG) and CC.     These analogies include: On demand service, Pay-Per-Use (PPU) model, the Elasticity of the resources, load balancing and even water cooling,     After the Amazon EC2 service disruption on April 21 st , 2011, we can identify more similarities between EPG and CC in disasters related issues. These similarities include: 1. A global damage (with immediate and delayed components). 2. Uncontrolled behavior of the resources (neutron population vs. loss of connectivity or fuel rods meltdown vs. failing servers). 3. During the crisis, similar announcements to the public which minimize the catastrophe. 4. After the crisis, publication of the event investigation in length. 5. Loss of confidence in the technology by the users.

not so good :(

Advanced Cloud based solutions: Voltaire-IGT hosting eBay, XIV in Voltaire Cloud Centre of Excellence May 12, 09:30-13:00 Location : Voltaire Offices, 13 Zarchin St., Raanana The agenda: 09:30 -10:00 Coffee and croissant gathering                                               Avner Algom: IGT Welcome 10:00-10:30  “ Cloud Centre of Excellence ”                                               Asaf Somekh, Voltaire 10:30-11:00    "Grid-based storage: The complementary solution for cloud computing" Hanoch Ben-David, XIV 11:00-11:30 “ Virtualized Data Centre ”                             ...

IGT HPC Work Group Meeting - Scalable x86-based solutions for HPC Users: Clusters, Cloud, and Shared Memory (SMP) in a unified platform Wednesday, March 3rd, 2010 IGT Offices, Maskit 4, 5th Floor, Hertzliya. 13:45-14:00: Gathering 14:00-14:05: Opening - Avner & Guy 14:05-15:00: Part 1 15:00-15:10: Coffee Break 15:10-16:00: Part 2 16:00-16:15: Discussion and concluding remarks Title: Scalable x86-based solutions for HPC Users: Clusters, Cloud, and Shared Memory (SMP) in a unified platform Abstracts: IBM (Gilad Berman, System x Technical Specialist) Scalable Data Center alternatives: iDataplex, BladeCenter, new management software iDataPlex technology offers a new innovative design to address the needs of the data center with extreme density and simplified manageability while reducing power and cooling consumption. BladeCenter is an established, open design with a flexible, scalable architecture that offers a true alternative to today’s sprawling racks and overheated ser...

IEEE 2010 CBSA: Cloud-based Services and Applications Miami Florida, USA Date: July 5 - 10, 2010 Workshop chair Prof. Mark Baker, SSE, University of Reading, UK. Email: mark DOT baker AT computer DOT org Description Cloud computing is increasingly being used for what was known as "on-demand" and "utility computing". The services provided, the APIs and the applications that can be hosted by these Cloud providers have superseded the use of the grid, and are increasingly becoming popular with users. The Cloud is a paradigm shift, where details are abstracted from the users; they no longer need expert knowledge about using the various technologies and running their applications on service infrastructure. Cloud computing provides a consumption and delivery model for IT services based on Internet, and it typically involves the provision of dynamically scalable and virtualized services. There services that are provided by various Cloud providers, which incl...

"To any computing resource there might be a possible demand that will break it"

Cloud-based Services and Applications Chairs: Prof Mark Baker, University of Reading Dr. Marcel Kunze, Forschungszentrum, Karlsruhe Abstract Cloud computing is increasingly being used for what was known as “on-demand” and “utility computing”. The services provided, the APIs and the applications that can be hosted by these Cloud providers have superseded the use of the grid, and are increasingly becoming popular with users. There are obviously two sides to the services that are provided by Cloud providers: those that are supplied by commercial entities, such as Amazon and Google , as well as those that are open-source systems, such as provided by OpenCirrus and Eucalyptus . In this workshop we wish to examine and explore the services, interfaces and types of applications that can be executed on Cloud systems. In addition, we are interested in the interfaces used to access the underlying services, the pros/cons of using virtualisation, the range and scope of applicat...

Miron Livny talking at the IGT event, July 15th, 2009. The presentation of Dhruba Borthakur about Hadoop and Condor is available here .

Prof. Miron Livny The Head of the Condor project: Open Source for High Throughput Computing (HTC) http://www.cs.wisc.edu/condor/ Condor and the Cloud - The Challenges and the Roadmap of Condor The goal of the Condor® Project is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources. Today, Condor is being used as a service in private clouds, Amazon EC2 and is embedded in Redhat Linux. Dhruba Borthakur Software Engineer at Facebook and Project Lead for Apache Hadoop File System Hadoop Distributed File System (including Hive) & Condor I discuss the design and architecture of the Hadoop Distributed File system. I then talk about configuration details about the private Hadoop Cloud used by Facebook to process petabytes of data. Date: July 15th, 2009 14:30-17:00 Location: Microsoft R&D Center, Hertzelia To reserve your place, please send your ...

Following OnLive at GDC and others I would like to suggest the term GaaS to stand for Game as a Service . GaaS represents streaming games services that are delivered to end-users (with thin clients) by a Cloud Computing infastructure. Charging can be done according to a Pay-Per-Use model.

Next time you will need computing resources, e.g. a web server, get it from the cloud, it is simple and easy! This post is not meant to be a full tutorial but only a brief description of my own personal experience playing with Amazon EC2. For more complete information about working with Amazon EC2 check this or this references or browse here for additional documentation Step 1: Create an Amazon Elastic Compute Cloud (EC2) account. Pricing and additional information is available here . Step 2: Download the Amazon command line API tools and/or install the Elasticfox - Firefox plug-in . Step 3: Set the security keys to allow SSH. Step 4: Configure the Elasticfox (for example open port 22 for SSH and port 80 for http in my case). Step 5. I used one of the pre-configured Amazon Machine Images (AMI), therefore starting the machine was immediate. Step 6: Enjoy the new virtual machine - see screen shots below: Figure 1: The Amazon Elasticfox GUI. Figure 2: Connecting to the machine via S...

The event announcement The Israeli Association of Grid Technologies ( IGT )

First trials with Xcerion XIOS/3 Beta. A remote OS and applications consumed completely from the "Cloud". All you need is a Web Browser. Xcerion looks cool although at the moment it works only on top of IE6+ and not yet on top of Firefox. The response time is reasonable and the Windows Manager is nice and intuitive: (click on the image to enlarge) A thin client/OLPC and Xcerion can be an interesting cheap computing platform.

I followed the Hadoop Quickstart guide and the whole process is described below. This post can be used as a reference for other people installing Hadoop. My system is OpenSuse 10.3 and Java version is 1.6.0_03. After downloading and installing the package I did the Standalone operation test : $ mkdir input $ cp conf/*.xml input $ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+' $ cat output/* Here is the output ( line feeds may be corrupted, sorry for that ): gtz2:/home/telzur/downloads/hadoop-0.14.4 # bin/hadoop jar hadoop-0.14.4-examples.jar grep input output 'dfs[a-z.]+' 08/01/05 15:47:13 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 08/01/05 15:47:13 INFO mapred.FileInputFormat: Total input paths to process : 3 08/01/05 15:47:13 INFO mapred.JobClient: Running job: job_local_1 08/01/05 15:47:13 INFO mapred.MapTask: numReduceTasks: 1 08/01/05 15:47:13 INFO mapred.LocalJobRunner: file:...