2 U.S.C. § 21

Oath of Senators

The oath of office shall be administered by the President of the Senate to each Senator who shall be elected, previous to his taking his seat.

(R.S. § 28.)