Smooth works strangely or not at all
Smoothing works with convex and even star-shaped concave faces. However, it can give unwanted results with concave faces where the center point is not inside the face.
To fix a concave faces, use the Multi-Cut Tool or Mesh > Triangulate.