I read this question in a forum and I was totally surprise at the many “yes” replies and the fact there were no good answers. Not one person wrote “no.”
Here is the non-politically correct answer: “It depends.”
The reason is that dehumidify water is consider “grey water” not pure water because of the mechanic process that it goes through to become liquid H2O. There is a chance of lead, mold and other nasties residing in the Dehumidifier receptacle water.
Take the time and not waste the water by filtering (99%) and purifying(100%) it before consumption.