The official website of the Supreme Court provides transcripts of oral arguments from 1968 to the present day.
Here you can find a comprehensive collection of recordings of oral arguments beginning in 1968 and selectively back to 1955.
