Posts

Showing posts with the label Grid Computing

HTCondor version 8.0 Windows Installation

HTCondor version 8.0 Windows Installation from gtelzur http://www.slideshare.net/gtelzur/condor8-win-install

Globus Provision

Image
I tested globus-provision which is an easy way to have a globus+condor cluster ready for number crunching on Amazon’s EC2 cloud. My front end was my laptop which runs Windows. Python on Windows does not behave exactly as on Linux when it comes to SIGINT and therefore os.fork() generated an error message. Thanks to the support of  Borja Sotomayor the SIGINT issues has resolved and the solution was to by-pass the SIGINT so I could proceed with the test. You can read more about this issue from here: http://jira.globus.org/browse/GP-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel I tried the example from: http://globus.org/provision/guide_compute_go.html#guide-compute-go I decided not to use globusonline for the eBooks transfer and I used wget instead. Below are a few screen captures that show the test. My configuration file:  Preparing the instance: after a minute or two: checking the instance: Watching my cluster at the AWS management ...

The End of Supercomputers As We Know Them Today

About four years ago I predicted in this blog the fall of Grid Computing and the rise of Cloud Computing (  http://telzur.blogspot.com/2007/10/end-of-grid-computing.html  ) Now I want to claim that Supercomputers as we know them today will not be the kind we will see in the future. I think that within a couple of years: 1. Most supercomputers will shift to the cloud (HPC Cloud). 2. The governance of X86 is not guaranteed: We already see the rise of GPGPUs and we will see more families of technologies being involved, e.g. Tegra and ARM, Reconfigureable Computing (RC) i.e. FPGAs, etc'. 3. Supercomputers won't be anymore General Purpose machines. They will be reconstructed as a Cloud Service ( Supercomputing as a Service ) from all the available technologies (see previous section) per single mission (program) in order to maximize the performance and minimize the consumed energy and cost. I decided to use the word mission because the word  task is u...

IGT HPC Work Group Meeting - Scalable x86-based solutions for HPC

IGT HPC Work Group Meeting - Scalable x86-based solutions for HPC Users: Clusters, Cloud, and Shared Memory (SMP) in a unified platform Wednesday, March 3rd, 2010 IGT Offices, Maskit 4, 5th Floor, Hertzliya. 13:45-14:00: Gathering 14:00-14:05: Opening - Avner & Guy 14:05-15:00: Part 1 15:00-15:10: Coffee Break 15:10-16:00: Part 2 16:00-16:15: Discussion and concluding remarks Title: Scalable x86-based solutions for HPC Users: Clusters, Cloud, and Shared Memory (SMP) in a unified platform Abstracts: IBM (Gilad Berman, System x Technical Specialist) Scalable Data Center alternatives: iDataplex, BladeCenter, new management software iDataPlex technology offers a new innovative design to address the needs of the data center with extreme density and simplified manageability while reducing power and cooling consumption. BladeCenter is an established, open design with a flexible, scalable architecture that offers a true alternative to today’s sprawling racks and overheated ser...

Condor at the IGT

Image
Miron Livny talking at the IGT event, July 15th, 2009. The presentation of Dhruba Borthakur about Hadoop and Condor is available here .

IGT Event: HPC Workgroup Meeting at Voltaire

Date: Jul 23, 2009 09:30 12:30 Location: Voltaire, 13 Zarchin St. Raanana Agenda Assaf Somekh VP Marketing & Strategic Alliances "New products and developments" Tom Thirer Fabric Management product manager will present "UFM: How to optimize performance with less operational efforts" Amit Katz Ethernet Platform product manager "10GbE in the HPC Market” Assaf Wachtel InfiniBand Platform product manager will present "40 Gb/s InfiniBand Switching Portfolio" Amit Katz Ethernet Platform product manager “ Accelerating Open MPI with InfiniBand or 10GbE ” To reserve your place, please send your contact details to: info@grid.org.il Date Jul 23, 2009 09:30 12:30 Location Voltaire, 13 Zarchin St. Raanana

Multiplying the Power of Mathematica 7 Over the GRID

The IGT, Engineering Software Lab and Wolfram Research are happy to invite you to this interesting Mini Seminar on the subject of: Multiplying the Power of Mathematica 7 over the GRID (Plus an introduction to the new computational knowledge search engine Wolfram Alpha ) About the Speaker: Jon McLoone has worked with Wolfram Research, makers of Mathematica, since 1992 on software development, system design, technical writing, and strategy. He supports educational projects in cooperation with universities and government research, and has lectured on Mathematica around the world. McLoone has a degree in mathematics from Durham University, United Kingdom. A Video recording of a lecture on Mathematica Lightweight Grid systems by Jon can be viewed here: Using the Wolfram Lightweight Grid System The Seminar: Part 1 Multiplying the Power of Mathematica 7 over the GRID : An introduction to Grid Computing parallel computing and HPC with Mathematica 7 and gridMathematica Th...

IGT2008 - IGT Annual Event - Cloud Computing the Next Grid Evolution - Dec. 1-2, 2008 Hertzelia, Israel

Image
The event announcement The Israeli Association of Grid Technologies ( IGT )

Grid Computing in Israel

Last week I attendded the HP-Cast 10 conference which took place in Singapore. At the conference, as a delegate of the Israeli Association of Grid Technologies , I gave an overview presentation about Grid Computing in Israel. The presentation PDF file is available here .

IGT Grid-HPC WG Meeting: UNICORE - A European Grid Technology

THE NEXT GRID-HPC WORK GROUP MEETING Monday, March 31th, 2008 IGT Offices, Maskit 4, 5th Floor, Hertzliya Agenda: 14:00-14:15: OPENING - Avner & Guy 14:15-15:15: UNICORE - A European Grid Technology Speaker: Dr. Achim Streit Head of Division "Distributed Systems and Grid Computing" Jülich Supercomputing Center Insitute for Advanced Simulation Forschungszentrum Jülich GmbH Abstract: The development of UNICORE started back in 1997 with two projects funded by the German ministry of education and research (BMBF). UNICORE is a vertically integrated Grid middleware, which provides a seamless, secure, and intuitive access to distributed resources and data and provides components on all levels of a Grid architecture from an easy-to-use graphical client down to the interfaces to the Grid resources. Furthermore, UNICORE has a strong support for workflows while security is...

Cloud Computing is here to stay

Image
First trials with Xcerion XIOS/3 Beta. A remote OS and applications consumed completely from the "Cloud". All you need is a Web Browser. Xcerion looks cool although at the moment it works only on top of IE6+ and not yet on top of Firefox. The response time is reasonable and the Windows Manager is nice and intuitive: (click on the image to enlarge) A thin client/OLPC and Xcerion can be an interesting cheap computing platform.

A special lecture at the BGU by Barton Miller

Image
Distinguished Lecture Guest: Prof. Barton P. Miller Computer Science Department University of Wisconsin - Madison Monday, January 28th, 2008 14:00-16:00 in the Saal Auditorium (202), Alon Hi-Tech Bldg (37) at the Ben-Gurion University of the Negev, Beer-Sheva A Framework for Binary Code Analysis and Static and Dynamic Patching Barton P. Miller Computer Sciences Department University of Wisconsin Madison, WI 53706 bart@cs.wisc.edu Tools that analyze and modify binary code are crucial to many areas of computer science, including cyber forensics, program tracing, debugging, testing, performance profiling, performance modeling, and software engineering. While there are many tools used to support these activities, these tools have significant limitations in functionality, efficiency, accuracy, portability, and availability. To overcome these limitations, we are actively working on the design and implementation of a n...

"Grid Confinement" - A Physicist perspective

Image
The following post should not be taken too seriously! If Grid Computing is so good but what we see practically is a complete chaos in the Data Center then there must exist an Anti-Grid that cancels all its benefits. If one tries to make an order and to split the Data Center into two separate sites then immediately Grid - Anti-Grid pairs are produced out of the vacuum and chaos is being restored.

Social Networks and Grid Computing - Some similarities

Image
There are some similarities between Social Networks, e.g. Facebook and Grid Computing. In the table below I mention a few. .

Que es mas macho, BlueGene o EGEE? (*)

Image
I just read in Supercomputingonline about EGEE III, the 3rd phase of the gigantic Grid Computing project: " EGEE-III will last for 24 months, with a total manpower bid of almost 10,000 person months and an EC budget of Euro 36 million. As with EGEE-II, partners will provide extra effort to the project beyond that funded by the EC, bringing the total project budget up to Euro 70 million, and also contributing a further estimated Euro 50 million worth of computing resources." and I ask myself what is more justified , a single extended 3PFLOPs BlueGene/P with 884,736-processors or thousands of various kinds of old 32 bit boxes distributed all over the world running Scientific Linux 3.0.X and gLite? For years we were told that no single data center site will be able to cope with a few PB of data per year that will be produced by the LHC; Nice Powerpoint presentations showed a 20km tower of CDROMs, higher than the Mt. Blanc, indicating that only distributed Grid Computing environ...

Invitation to the next IGT HPC Work group meeting

Image
Monday, March 26th, 2007 IGT Offices, Maskit 4, 5th Floor, Hertzliya Agenda: 14:00-14:15: OPENING - Avner & Guy 14:15-14:50: PPF, JAVA, OPEN-SOURCE AND GRID: BEYOND THE TRADITIONAL GRID Speaker: Laurent Cohen, ILOG, Inc. and JPPF founder Abstract: Traditional Grid architectures rely on a concept of job submission that comes with a set of constraints regarding the nature of the compute nodes, the ease of deployment of the jobs, and the effort required to use the Grid, which could otherwise be utilized to work on the problems to solve. JPPF offers an alternative, enabling a true heterogeneous nature of the Grid components, an ease of use that permits ...