why is that your goal, to be at the lowest weight for your height?
Different people are built differently. If you are any bit broad, or muscular, or just ”heavy-boned”, you shouldnt be at that lowest weight anyhow. A number on a scale is not a great goal in and of itself.
Assuming your weight loss goal IS healthy and dr approved, losing inches instead of numbers is a good thing. Keep in mind too that muscle weighs more than fat