By adhering to the well-known OpenAI Gym paradigm, HomeLabGym is a Python-based environment from the AI4E team that allows researchers to prototype, deploy, and analyze home energy management system (HEMS) controllers within the controlled test environment of HomeLab, providing access to all its available sensors and smart appliances. Via HomeLabGym the step from simulation to testing with real flexible assets such as the available home battery and heat pump in HomeLab becomes very small.