The arrows on the ruler on the upper right side only adjust gutter width, not column width.
You have two suboptions with Dynamic Columns - Auto height or Manual height. Static Columns allows you to choose the number of columns