I could not start the rails console while I was in the project directory with:

rails c

Issue was with readline and ncurses libraries. Go to

~/.rvm/src/ruby-1.9.2-p0/ext/readline
ruby extconf.rb
make
make install

That should do it…