Our new preprint proposes a hierarchical control framework that combines model predictive control and reinforcement learning to balance second-by-second market decisions with long-term battery health, extending battery lifetime by 84% and increasing profit by 34% compared with MPC baselines.