As a rule of thumb, salvage gold armors over 200g value and weapons with the "Highly salvageable item", and use expert kits most of the time.
Use the common kits only with low-level stuff and stuff that never salvages into rare materials like some trophies.
For example, most ghost remains (like Phantom Residue from ghosts in the underworld) salvage just into piles of dust and nothing else, so there's no need to waste expert salvage kit uses, you'll never get more materials or better materials by using expert kits.
Other trophies may salvage into rare materials. Use ALWAYS expert salvage kits on them.
I got the gems for my first Vabbian armor just by salvaging Geodes, Djinn essences, and weapons that look 'jeweled' or have gem-related names like Ruby daggers.
You can check the wiki when you have doubts about what an item may drop. There are many "contains" categories listing many items that may salvage into rare materials:
http://wiki.guildwars.com/wiki/Categ...fting_material