Open your contacts app (not the tab on the dialer app). Click on the menu icon on the top left and a page will slide out that looks like this
Click on the All Contacts and you will see this to see where your contacts are located.
if the contacts you want are located in a single location, select that to show and those will be the only contacts to show - assuming you want to keep the ones you don't want to show. If you want to completely get rid of the ones you don't want, select Manage Contacts and choose an action. My suggestion would be to merge contacts (will get rid of any duplicates) and then move them into Google. Having them in Google contacts allows you to add/delete and access from anywhere and available on any device. You can go to contacts.google.com to mass delete any contacts you do not want and hide contacts you don't want to see but still want to keep.
are you clicking the hamburger menu on the left and not the three dot menu on the right?
