LlamaGym stands as a pioneering utility engineered to streamline the fine-tuning of large language model (LLM) agents via reinforcement learning techniques. Mirroring the way OpenAI's Gym standardizes reinforcement learning environments, LlamaGym offers a uniform setting for these LLM agents. It grants users the ease of conducting experiments and perfecting the prompts and hyperparameters associated with agent training.