Toward the end of the 1930s, Frick began to lose influence and power.

In 1936, he lost the power over police to Heinrich Himmler. In 1943, Himmler also replaced Frick as the Minister of the Interior.

He became the Protector of Bohemia and Moravia until the end of World War 2, where he hunted down anybody who stood against the Nazis.