Does it matter what college you get your degree from?

Does it matter where i get my bachelors degree? I mean i know that if you go to Harvard or something then it matters. But if i go to a less known college Oakland University, compared to like Michigan State University. Would it matter when looking for a job?