A Treasury minister has conceded the measures in the budget do hit "working people" - but insisted Labour had not broken their manifesto promises.