Founded in 1962, Compostela spent the better part of that and the following decades playing regional football. Its first promotion to a semi-national stage occurred in 1977, with a promotion to Segunda División B (Group 1), which lasted just one season; Compos promoted again in 1980, this time lasting six years.

Relegation in 1986 was compounded by off-field controversy surrounding the actions of then president Francisco Steppe. He resigned amid allegations of receipt of payments to throw a game against Pontevedra CF, which would assure the opposition's maintenance in the category. The late 1980s saw a significant restructuring of the club both at board and management levels and, in 1990, Compostela regained third-level status.

The following campaign was to prove the club's most successful to date. On 23 June 1991, a capacity crowd of 8,000 at the Estadio Municipal Santa Isabel, saw goals from Juanito and Ochoa (two) clinch a 3–1 victory in the final play-off match against CD Badajoz, for a first-ever Segunda División visit.

The move to Estadio Multiusos de San Lázaro coincided with the continuing rise in the team’s fortunes and, at the end of 1993–94, following a 3–1 play-off victory against Rayo Vallecano, Compostela reached La Liga. For a small regional club it did remarkably well, and reached a best finish of 10th in 1995–96, mainly courtesy of strikers Christopher Ohen and Bent Christensen, whom totalled 23 league goals.