With backlinks, it isn't just who you link, it is about who is linking to you. That can be very difficult to control, as bad sites want to link to good ones for the same reason your good site does, and you can't make them take a link down or make it nofollow. About the only thing you can do is try to write content that large sites want to link to.