If your ortho size is small (around 1), Unity's collision system with the default parameters will penetrate slightly. If you want to avoid this, you'll have to either change physics settings in Edit > Project Settings > Physics, or change the ortho size of the scene (and the ortho size in the sprite collection to compensate for this too).