To get OpenSSL to compile and install with Ruby on Ubuntu, you need to follow these steps after youve installed ruby.
Read it here
However, for some reason, the default way of compiling Ruby from source on Ubuntu leaves out the installation of OpenSSL support. I had the development openssl libraries package installed, so that wasnt it. I didnt see any errors in the configure process or during compilation.