Linux Users Group Manipal » varun http://www.lugmanipal.org The Best Things in Life are Free Fri, 09 Apr 2010 16:18:13 +0000 http://wordpress.org/?v=2.9.2 en hourly 1 Distributed Computing and MapReduce http://www.lugmanipal.org/2010/04/09/distributed-computing-and-mapreduce/ http://www.lugmanipal.org/2010/04/09/distributed-computing-and-mapreduce/#comments Fri, 09 Apr 2010 16:18:13 +0000 varun http://www.lugmanipal.org/?p=250 Today I conducted a session on Distributed Computing. It mainly focussed on MapReduce and its open source implementation-Hadoop.

The session first covered a brief idea of why we need to have distributed computing since everything is driven by need.Then It covered how a distributed file system works.It focussed on the Google File System.A demonstartion of how Hadoop works on a single node enviornment where a example very similar to the wordcount example was show. It was an election simulation where the input was the votes cast and the Hadoop Job aggregated the results.After this some finer details about Hadoop was covered which was the last topic in the session.

Some resources that are very helpful:

http://code.google.com/edu/parallel/index.html#hadoop

Slides for the session:

http://www.slideshare.net/varunthacker/distributed-computing-3635200

http://www.jakobhoman.com/search/label/Hadoop

How to setup an Hadoop enviorment:

http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29

http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Multi-Node_Cluster%29

]]> http://www.lugmanipal.org/2010/04/09/distributed-computing-and-mapreduce/feed/ 1 Round-up on the search engines and a troubleshooting linux sessions http://www.lugmanipal.org/2009/03/08/round-up-on-the-search-engines-and-a-troubleshooting-linux-sessions/ http://www.lugmanipal.org/2009/03/08/round-up-on-the-search-engines-and-a-troubleshooting-linux-sessions/#comments Sun, 08 Mar 2009 14:37:04 +0000 varun http://www.lugmanipal.org/?p=127 A talk on search engines and a troubleshooting session were the reasons
for the gathering on the 25th and the 26th of February 2009.

The aim of the talk was to give a brief account on everything related
to search engine technology.It started with an introduction to search
engines and then went on to tell about the different types of search
engines technologies.Then we focused on the Google search engine
architecture.After that SEO’s techniques were discussed and Google’s
webmaster tools was shown.Now the final topic of how to get the best
results out of Google’s search engine with the knowledge of some
operators was covered.This is what the talk consisted of.

The reason for the troubleshooting session on the second day was for
users facing problems while operating Linux.Users discussed their
problems and were solved one by one.Some of the common problems
included users were facing is to get the package manager working using
our colleges proxy server. Next, they were shown how to install
packages manually in linux. This topic proceeded with a small discussion
on how to clear the dependencies.Then we had a quick glance through the
different shells and desktop environments in linux. The session ended
by showing the users how to run C and C++ programs on linux.

]]> http://www.lugmanipal.org/2009/03/08/round-up-on-the-search-engines-and-a-troubleshooting-linux-sessions/feed/ 1