Sento (neighborhood bathhouses) cost 500–600 yen and are an authentic local experience. Bring soap and a towel.
Same rules as onsen: wash first, then soak. Tattoos are usually accepted at sento, less so at onsen.
Schedule for late afternoon when locals come after work. Conversations in mixed broken Japanese-English have made my Tokyo trips.