"We don't need any more taxation and basically that's what this is," said Jim Bitter whose owned a home along Lake Brownwood for the past decade.
That's because residents living along lake Brownwood don't own the water- it's state property.
Now city officials want to begin charging them a yearly fee to use it.
"Water when it rains runs off of our property into the lake yet they're wanting to charge us when we want to take the deposit that we just made back," said Bitter.
Many owners like Jim Bitter rely on the lake as their only source of water.
He's even built his own pipe system to reach his home.
"I have had to pay for the pump, the electricity, the line, the maintenance on the lines and the purification of the water," said the retired law enforcement officer.
Residents living along lake Brownwood haven't had to pay for using water from the lake since it was built 80 years ago, now that the levels are lower than ever city officials say paying is only the fair thing for them to do.
"They're getting an amount of water out of lake Brownwood that they're not paying for where everyone else in the county is paying for that water," said Dennis Spinks, the general manager at the Brownwood Water Improvement District No. 1.
Some residents actually agree.
"Were in a situation here where everyone needs to do their part," said Torjie Sweeten who lives along the lake.
Homeowners could have to pay up to $400 a year, depending on the lot size.
Officials say they'll use that toward research to find alternative water sources.
Residents say that's not their price to pay and it never has been.
"If it isn't broke dont fix it," said Bitter.
Board members of the Brownwood Water Improvement District have decided to set up a committee specifically dedicated to discuss the issue before deciding on whether or not to implement a fee.
If the fee is implemented, homeowners would have to sign a contract with the city agreeing to pay.
The ordinance would go into effect by Jan. 1, 2013.