No, of course not. There is absolutely no reason to think so. The text is presented as historical narrative. It even says, 'morning, evening, the X day'. How much clearer could it be. Furthermore, Abraham lived roughly 200 years; was that allegorical? To start cutting up God's Word is a dangerous slope, just look at those people who do argue that Abraham, Moses, David, the prophets, and even parts of the New Testament, didn't exist.
To address another concern, yes Moses wrote Genesis-Deuteronomy. He was inspired by the Holy Spirit, that is, though Moses was the human author, the Holy Spirit was the divine author (as He was for the entire Bible). God in a sense told Moses what to write, while preserving Moses' personality and writing style. In pact, I believe it is in one of Peter's epistles that he says that the prophets would marvel at what they wrote, because they could not fully understand it. so yes, Moses physically penned the creation account, along with everything else in Genesis, but we have no reason to suspect that, because he did not live in that time, that the entire book of Genesis is inaccurate. If you claim this, then you are either deny the innerancy and inspiration of the Bible, or you are saying God got it wrong.