Quite true. A very significant energy storage technology is really all that is needed. While this would also help lasers, I think gauss weapons are more useful to the average soldier than a laser rifle.
Modern lithium ion cells are surprisingly dense, and the technology is moving forward really quickly. My phone power bank weighs less than half a kg (I think it has 4 18650 cells in it) and from the blurb on the package it holds about 360kj of energy (5vx20 amp-hours).
Even at less than 100% efficiency, that's enough to impart rifle bullet levels of kinetic energy to 100+ rounds and is equivalent in energy to the explosive yield of 85g of TNT. It's not hard to see why the authorities are getting toey about allowing big lithium ion batteries on flights.
Fast charge/discharge capabilities are also improving very quickly, and ultracapacitor tech is also undergoing rapid advancement.
Practically, to power something like a gauss rifle on fully automatic fire you would need something like 50kW, depending on the desired muzzle energy and the efficiency of the accelerator. Today, a high discharge 18650 can support drawing about 100w, and the batteries weigh about 45g each. With that capability (and assuming no scale efficiencies or heat dissipation problems) a 50kw battery pack would weigh 22kg and last about 3,600 rounds or 6 minutes of continuous firing.
On average, lithium ion battery tech is improving in capacity by about 8% per year, although at that rate it will be approaching the theoretical limits of the chemistry in 20 years or so. There is plenty of headroom in the discharge rates, although heat dissipation will become a problem.
If you put an ultracapacitor bank into the mix that could hold ready power for 10-100 rds (say one magazine) then you could have the ability to fire rapid bursts with a slower sustained rate of fire. It's not hard to envisage the tech being used to make a power pack weighing 5kg or so and capable of powering 1,000 rounds. It could be charged in an hour from a wall socket or a few minutes from something like an electric car charging point.
This tech could be available within a generation - possibly within the next few years - if someone came up with a requirement and a bucket of money for the R&D.