If you use the following .htaccess file, it will only rewrite the url if the file you browse to doesn't exist

RewriteEngine on
RewriteCond %{SCRIPT_FILENAME} !-f
RewriteCond %{SCRIPT_FILENAME} !-d
RewriteRule ^(.*)$ index.php/$1