There are two reasons,one you mentioned.The second reason is brought by the Sharei Tshuvua 460:2 which says that we are afraid of someone mistaking matzah meal for flour(based on an actual story ).According to this second reason time is not a factor.
Menu