Does public access cover fishing?

No. Allemansrätten is about moving in nature under responsibility — not about taking fish. Fishing rights belong to the landowner or the manager. In put and take that right is sold as a fishing permit.

An open car park and a path to the bank do not mean you may cast. Buy the card for that water first. More: do I need a permit? and what put and take is.