I just put a house in last fall and have a ton of rocks ranging from pebbles up to big rocks. Will this work to get rid of them.

Yes

It's a good rake but don't stress it to much. I used it to rake out some rocks and crabgrass, it worked but head is loose. Definitely worth the money though.

for the small rock yes, large rock no.

It's fine for small gravel, but I wouldn't put too much stress on it. I raked 2 tons of lava rock around with it - but that's light rock. If you have heavy stone - like river rock - that is 2" or bigger, it won't hold up very long. The weak point is the head and it's attachment to the pole. The fiberglass pole is great and strong. The tines are attached to it with two rivets (not great) via what is basically a fat wire (look closely at the picture). Put too much stress on the tines, and that metal/wire coming out of the poll will bend pretty easily. Sorry!