'Sumimasen' (excuse me / sorry / thank you), 'arigatou gozaimasu' (thank you), and 'onegaishimasu' (please) get you far.
Locals deeply appreciate the effort. Most will not expect tourists to speak Japanese but light up when you try.
Google Translate's camera mode is excellent for menus and signs. Download Japanese for offline use.