I thought the location of the apostrophe/double quote would grow on me, but after giving it a try for two weeks I've decided to pop out the key and swap it with the semi-colon/colon key. BTW, this was very easy to do, provided you have a strong fingernail: just lift up the key slowly but with firm pressure starting in the lower, right-hand side of the key. Once that corner snaps off, you should be able to easily snap off the lower, left-hand side corner and then finally the upper part of the key. They snap back on pretty easily.
In any case, once that's done, you'll need to do the following:
Create a new folder in your home directory and call it Bin.
Open-up a text editor (Applications->Accessories->Text Editor) and copy-and-paste the following:
#!/bin/sh
xmodmap -e "keycode 47 = apostrophe quotedbl"
xmodmap -e "keycode 48 = semicolon colon"
Save the file in your new Bin folder as swap_quote_semicolon.sh
Open-up the file browser, right-click on the new file, and select Properties. On the 'Permissions' tab, make sure that the 'Allow executing file as program' option is checked. Close the Properties window.
Go to System->Preferences->Sessions. Click the 'Add' button to add a new session with the following details:
_Name:_ Swap Apostrophe and Semi Colon _Command:_ /home/<user>/Bin/swap_quote_semicolon.sh _Comment:_ Added by me
In the above, replace <user> with your username.
That's it, once you logout and log back in, your swapped keys should now work properly. That is, each time you login, the above will be executed and the keys will be swapped.