The most basic brick-building material in antiquity is sun-baked clay or mud. It is a pretty tough, resistant material of its own right. If this were the brick used to build the Tower of Babel, the structure itself would have stood only 1500 feet above the ground. But there was a statement in the Old Testament that the bricks may have been heated rather than left to bake under the sun. Studies have shown that heated bricks are even more resistant than the traditional sun-baked bricks. If this were the case, Babel would have been a pyramid closer to half a mile tall.
But the bricks used to build the pyramids of ancient Egypt are primarily limestone. Limestone made possible the Great Pyramid's dizzying height of 481 feet.
Let's go back to the megapyramid, the Egyptian pyramid as big as Shimizu--2004 meters tall and eight square miles in area. Which material would best suit the weight of a pyramid of that size, stone or heated brick?
For more on this Egyptian megapyramid: