Land of "milk and honey"???

It has been in the back of my mind for quite some time. When did the land of milk and honey turn into a wilderness? There had to be a period when it happened.

This morning I read Ezekiel and verses 13-14 reads: "And they will know that I am the Lord, when their people lie slain among their idols around their altars, on every high hill and on all the mountaintops, under every spreading tree and every leafy oak—places where they offered fragrant incense to all their idols. 14 And I will stretch out my hand against them and make the land a desolate waste from the desert to Diblah—wherever they live. Then they will know that I am the Lord.’"

V13 indicates to me that it was still furtile at that time and then in v14 Father curses the land and Jerusalem is descroyed.

Is my thinking correct or do you know of a different period that the furtility of the land was changed to become a wilderness?