You have to, in the rainy season, go around looking for the "withered trunks" that are in the edge of the water and knock them down.
The trunks will fall in the water and drift away, this will eventually form a little bridge that you can cross to a new area where the Gil Snapper is.