Excel does not have a way of using a formula to move cells around. You would need to use VBA to do this. Given that you really don't have that much data to manipulate, relative to what you are trying to do (unless this is one spreadsheet out of many that you must handle), then you would probably be best off just selecting all cells in volumn B, cutting them, and pasting them at the bottom of column A. And then repeating, with columns C, D, E, and so on.
If you do handle this data in many sheets, is there a way of adjusting the source of the data so that it puts it all in one column to begin with?