Ubuntu does not come with a preinstalled compiler such as gcc. If you ever want to gain that functionality you need to execute sudo apt-get install gcc in the terminal. After you do this, if you want to install an application from source usually you extract the file to a folder (tar xjf for .tar.bz2 and tar xzf for .tar.gz) and then run the following commands:
cd /path/to/folder
./configure
make
make install
(PaulStamatiou)