Yes. The boss may not want his workers coming in unsupervised – that is generally a good policy when you are dealing with hourly workers.
In times like this, hourly workers should be very thankful they have any work at all. The boss could very well be living order to order as well, and he is probably careful not to have work build up on Yom Tov and Chol Hamoed.
If times were better, any good boss would look for heterim to keep people working whenever possible. There were years when I went off to EY or Paris for Chol Hamoed and kept people working for me while I was away. Now I do everything virtually through subcontractors and am also a subcontractor myself so there is no inyan.