I would start with your critical vendors such a core system. Score some of them and see how your rating system plays out. Take the same methodology and score some of your lower vendors. They may have to be modified over time, especially if you are just starting.