In Unity, only convex mesh colliders can collide with other mesh colliders. That means one of them will need to be tagged as convex, ideally the moving one.
Also, please note that you can't animate polygon colliders right now - they are very very expensive to change. You can move them, just not have frame animation on them.
This is a limit of the Physx engine used by Unity.