It may have seemed extreme to Joseph. He may have thought “I can protect my own”.
Regardless of what he may or may not have thought he moved his family out of there. He realized that there was no time for taking unnecessary risks.
The Spirit warns us. It teaches us where to go. It directs our steps. If you are feeling led in a different direction, no matter how ridiculous it may seem, follow the Spirit. Don’t risk harm to yourself or family because of a false sense of self-proclaimed security.