We have no contact with any civilizations beyond our galaxy.

[Too much open space to travel, even with the best hyperdrives.]

The Empire as it is now has only existed for a handful of decades, but it rose up from the Republic, which had been in place for thousands of years. There's no clear indication just how long they had been planning for this.