Many banks in the U.S. require an SSN to open an account. Two banks in Charlottesville will open accounts for you using your passport and DS-2019:
Bank of America
Both banks have branch offices adjacent to the University. Bank of America has an office on Grounds in Newcomb Hall.