What happens if I dont file my taxes?

If I file married jointly with my husband and our children it brings our tax amount down from 11,000 to about 2,000. If we file seperately we both get about 2,000 a piece. So can we file married and jointly and me just not put my w2 on there?? I mean since I am getting some sort of refund would I get in trouble?