I like your taste. You should totally set up an account on Backloggery and list all the games you've beaten, just so you have a place to keep track, and then can list the games you own and haven't beaten yet.
Among very new releases, I heartily recommend Unchained Blades (PSP, soon also on 3DS) and Ys Origin (PC).
Also, have you played Tactics Ogre? I just finished getting the good ending on the PSP remake (after getting bad ending), am doing some post-endgame content, and then will travel back in time to fill in the third of the three main branches in the story. The time travel unlock (via the "World" Tarot Card) after you beat the game once makes the game like 1000% more awesome than super-linear FF Tactics (IMO). I'm just butthurt because I managed to miss Cloud *again* on the PSP remake because I entered the final dungeon and saved without realizing I'd entered the final dungeon. None of that crap in TO.
Also, if you wanna go super-retro, try out the original Phantasy Star series. PS1 is hard to find because it was SMS (8-bit system), it's not on all the Sega Collections. But 2-3-4 are widely available and come in virtually every "collection" thingy Sega has released in the last 5 years.
EDIT -- you didn't mention any Atelier games. If you've played none, I recommend playing pretty much all of them. You can scrap the handheld ones, skip Atelier Iris 3 (Grand Fantasm), and maybe skip the Mana Khemia games if you don't like it after trying it. All the others are awesome in their own way, with Atelier Iris (the first one) and Atelier Totori being my favorites, mostly (but not entirely) because of their music.