According to science, yes it did. According to most religion, no it did not. Now, the simple answer to what is outside the universe is nothing. There is literally a point in the universe where it just stops. No stars, nothing. Just empty blackness. But the universe is constantly expanding.