At the Siege Tower, the farthest to the north from the starting area, behind that is a hill you can climb where you can find a yellow key at the top. From there, jump down and there is a yellow key-locked door. Inside, you can find collectible 3 and 4, a toy, and a codex entry.

The image above shows the key location, above the collectibles.