There are indeed many good restaurants and places to eat in Hong Kong, you can probably find here any cuisine your heart desires!

I believe most of the restaurants named so far are pretty pricey.

If you're really into what Hong Kong food is all about, I suggest just roaming the street stalls of Mongkok. Start from one end of the street and finish at the other end, I'm pretty sure you'll be full by then! You can get fish balls, fried foods, stinky tofu, chinese 'gai dan jai', drinks, desserts, etc. You probably won't break your wallet visiting street stalls...well depends on how much you can eat.

Another good mention is the famous egg tart in Hong Kong. Here's a link to the popular Tai Cheung Bakery where Chris Patten made famous. Tai Cheung Bakery, Hong Kong - Restaurants - VirtualTourist

And also you must visit some 'Dai Pai Dong' when you are here, they are old sit-down street stalls/outdoor restaurants in the older parts of Hong Kong. The are more and more becoming obsolete due to the crackdown by Hong Kong government. They serve Chinese dishes and noodles with the extra flavor. I think there are a couple of these still in the Central district.