Scared About Going To College?

I'm going to be a senior in the fall and so I have to start applying for colleges soon. I already have an idea of where I want to go and what I want to do but people keep saying it's a lot harder than high school. I'm kind of scared because last year I had a bunch of school work on top of taking the ACT, SAT (twice), high school exit exam, on top of learning Chinese and the midterm and final. If it's harder than that then it's going to be impossible!