I think one of the Atma Weapons is in the cave on the Floating Continent before it becomes the Floating Continent. For the life of me I can't remember the name of that cave. Cave of Seals?

The second one you can steal from one of the three statues towards the very end of the game. So you still have a chance at this one, at least.