In most cases, long press on the icon you want to remove then drag to the "X" REMOVE area and let go. Also, if you long press and release, a menu will pop up. click on "Info" menu item and you can also disable/uninstall/Force stop the app.
REMOVE only removes the icon from your display and leaves the app intact so you can drag it back to your screen at a later time if you want. UNINSTALL deletes the app from your device. DISABLE removes the icon from your home screen and turns off the app but does not delete it.