A controversial proposal to turn New Milton farmland into a quarry is set to go before councillors for a decision.