Wednesday, November 17, 2010

Upgrading Cloudera Hadoop VM From Intrepid (8.10) to Jaunty (9.04) and Configuring Shard Folders with Host OS

Notes gathered from trying to upgrade Ubuntu version on Cloudera Hadoop VM. The VM comes with version Ubuntu 8.10 Intrepid. Most of the source repo for this Ubuntu version is not supported and any apt-get install errors out with below error


Err http://us.archive.ubuntu.com intrepid-updates/main Packages
404 Not Found [IP: 91.189.88.46 80]
Err http://us.archive.ubuntu.com intrepid-updates/multiverse Packages
404 Not Found [IP: 91.189.88.46 80]
Err http://security.ubuntu.com intrepid-security/multiverse Packages
404 Not Found [IP: 91.189.88.37 80]
Err http://security.ubuntu.com intrepid-security/main Sources
404 Not Found [IP: 91.189.88.37 80]



This also causes an issue when installing the VMware tools as the tools install needs certain build packages installed however the apt-get won't work. Here's the step by step instruction from upgrading OS to installing VMWare tools to configuring shared folders from Host OS to cloudera vm

The upgrade from 8.10 to 9.04 is seamless and did not break anything on my end. I didn't change the VM a lot so if things would have broken I would have either fixed or downloaded the VM fresh form the Cloudera site :)


-------------- Upgrade O/S --------------


- launch terminal


- sudo do-release-upgrade


This will take close to 15-20mins with decent internet connection. Need to baby sit to confirm various choices. Once complete it will ask for a reboot. After reboot bring up terminal and do



- cat /etc/lsb-release


above should show 9.04 version now.

----------- Install VMWare Tools -----------------

Before doing that we need to install certain libraries. Run these commands



- sudo apt-get update

- sudo apt-get install gcc

- sudo apt-get install linux-headers-{sub from uname command}-server (run uname -a to get the server details and replace server number there)


- Follow instruction in below on how to install VMWare tools in Ubuntu

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1014522

------------ Configuring Shared Folders ------------

Here's a video instuction on how to configure the shared folder for VMware Fusion 3

http://www.youtube.com/watch?v=fxNqdE7IanQ

For VMWare Fusion versions 2 or Older its a little complex

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1013633