The amount of tax you pay to a state usually depends on your overall annual earnings and marital status. The state where the bet was placed usually charges the tax, not the state where the gambler resides. Individual states will also usually tax winnings themselves, although the amount they tax is much less than that charged by the federal government.