Right under the usual play is a little 'alternate play' link. Click that and a java interperter will fly open in its own window. This one lets you save your saves wherever you want. It might work better for some folks. Try it, give feedback. The usual player is in the usual place, so no one is left in the cold.
Edit: Removed. Will keep eyes open for alternatives.