Camerabag, backpack?

You people that go backpacking with your SLR's, how do you carry them with you?
I'm bringing my 350d with 1-2 lenses with me. Until now a small toploading camerabag has been sufficent, but constantly wearing one of those is annoying, and a security risk, plus it does not have room for extra batteries and the extra lens and extra equipment. I just bought a lowepro camera backpack, and it IS awsome, but its just too much to lug around 2 big backpacks.

How have solved these things? I want both camera and stuff to fit into one bag, my backpack. But I also want it with me at all times(when the big back is at the hotel, or in the storage of a bus/train). I've actully been thinking of "building" a compartment at the top or bottom of a 65l backpack, but that could be hard.
I need info on how you carried this stuff with you!

I just use my day pack nowdays, there are proper day packs with sub divided areas for lenses, chargers, etc.. but they usually cost a bit of money.
They might be worth buying, but i'm a tight git so haven't spashed out.

Two backpacks is actually the common way to go backpacking - your big heavy backpack on your back, and a small-ish daypack on the front for balance (it takes a day or two to get used to carrying a second backpack like that, but after that it comes natural, and it's far superior to any other way of carrying a second bag). Depending on your lowepro bag, you might use that as daypack, but I'd personally recommend looking for just a regular small backpack.

Then, I carried a small toploader - and kept this inside the daypack most of the time (along with my lonely planet, second lens (well padded), bottle of water and other valuables). When I was in locations where I expected to want to take photos, I removed the toploader from the daypack and carried it separately for easy access to my camera.
Having the camera bag inside the daypack most of the time has the added benefit of not screaming "steal me" quite so loudly.

I had my large bag on my back and a top-loader lowprow bag (still have it). I just hang the lowprow over my neck so it is front of me, and it rests on the shoulder straps of the backpak. I travelled for three months like this (even up mountains) and it worked great.

I had very easy access to my camera and nobody was getting it off me without a fight.

I think two backpacks is excessive...