An energy storage device is indicated comprising a plurality of thermal energy storage units (1) which each comprise a thermal storage element (3) made of a solid material, an electrical heating device (5) and a conduit. The electrical heating device (5) serves for heating the thermal storage element (3). The conduit (41) is adapted to guide a fluid (W, S) for transferring thermal energy from the thermal storage element (3) to the fluid (W, S). At least two of the thermal energy storage units (1) are connected in series, and a bypass conduit (16) is provided which allows the fluid (W, S) to bypass at least one thermal energy storage unit (1) of the at least two serially connected thermal energy storage units (1). A method for storing energy by means of such an energy storage device is also indicated.