Maps & rides
Two different volumes are involved, and that is the whole confusion: the app has its own voice setting, and the phone (or car) has a volume that only applies while the voice is speaking.
Turn the voice up in the appGoogle Maps: Tap your profile picture > Settings > Navigation settings > Guidance volume > choose Louder.
Apple Maps: Open Settings > Maps > Driving & Navigation > Navigation Voice Volume > choose Loud.
Wait until the voice is actually speaking, then turn the car's volume knob at that moment. The knob adjusts whatever is playing right then — so during directions, it adjusts the directions, without blasting your music afterward.