The solution is to declutter that context menu by removing unneccessary items. This can be achieved through the Commands tab of the Tools -> Customize dialog. Specifically, click on the Commands tab, and select the Context Menu button to start customizing anything and (almost) everything to do with those context menus.
Many of the entities within the Solution Explorer have some sort of representation here; the biggest issue you have will be finding the right place to start customizing.
For example, I have a method of Source Control integrated within the Visual Studio environment which causes 7 new menu items to appear when I right-click on a project (Check In, Check Out, Get Latest Version, etc). I do all of my source controlling outside of Visual Studio, so these menu items are just clutter to me. I go to Project and Solution Context Menu | Project and delete anything and everything related to Source Control. Now, when I right-click on a project, none of those options appear in the menu.