Prompt and Diffusion Model Engineer

VCCP Faith


VCCP is the challenger agency for challenger brands, with over 900 people around the world. We offer full-service marketing and brand experience solutions from advertising to media buying, content production to data science, customer mapping to platform design & build.


The VCCP Partnership has a unique culture, and we are looking for people who will make a positive contribution to this, therefore the candidate must have the following attributes: A collaborative nature An entrepreneurial spirit Take pride in their work Have an honest approach Be un-precious and be able to recognise that a good idea can come from anywhere Take responsibility


At VCCP, we’re passionate about merging the realms of creativity and cutting-edge technology. We’re looking for a talented Mid-Weight Prompt and Diffusion Model Engineer to be an integral part of our AI Creative Agency, faith. This role will require a unique blend of expertise in prompt creation and knowledge of diffusion models.


  • LLM Prompt Engineering: Work with agency departments to evaluate, develop and test possible prompt solutions to help increase efficiency and creative output.
  • LLM Fine tuning: Customise LLMs to a range of different needs, including tone-of-voice training, conversation modelling and more.
  • Diffusion Model Fine-Tuning and training: Understand, modify, and optimise diffusion models to suit specific project needs, ensuring consistent, high-quality outputs. Train bespoke LoRA, LyCORIS amd embeddings for specific brand assets and styles.
  • Diffusion Workflow Development: Create custom diffusion workflows for specific image generation tasks, that can be used by designers and art directors.
  • Model Integration: Work alongside our data science team to integrate and refine AI models, aligning them with the agency’s creative standards and client requisites.
  • API & Python Development: Utilise Python to craft scripts, tools, and integrations. Develop, test, and integrate plug-in APIs to bolster our creative toolset and drive efficiency through system interoperability.
  • Collaboration: Engage with creative directors, designers, copywriters, and other stakeholders, translating their requirements into technical specifications.
  • Learning mindset: Stay abreast with the latest in AI, machine learning, diffusion modelling, and Python development. Propose innovative improvements to our current processes and tools.
  • Documentation: Author clear documentation for prompts, APIs, Python scripts, diffusion model adjustments, and other technical tasks to facilitate comprehension by non-technical team members.
  • Training: Create and deliver appropriate AI upskilling training for different audiences and skillsets throughout the agency.


  • Bachelor’s degree in Computer Science, Engineering, or a related discipline.
  • Experience in AI, prompt creation, or diffusion model fine-tuning.
  • Proficiency with the Stable Diffusion ecosystem, specifically ComfyUI, Automatic1111, Kohya_SS etc.
  • Proficiency in Python development.
  • Solid grasp of the intricacies of diffusion models, their applications and the latest tools.
  • Hands-on experience with API development and integration.
  • Stellar problem-solving capabilities with a flair for creativity.
  • Effective communication skills in both written and verbal forms.
  • Adaptability to function in a dynamic, fast-paced environment.

VCCP DE&I Statement

We believe that DE&I is about creating a strong culture of inclusion within our agency, where everyone can thrive and be their authentic self. VCCP is an equal opportunity employer and does not discriminate on the basis of gender, age, disability, religion, belief, sexual orientation, marital status, or ethnicity. If you require any adjustments during the application or interview process, please let us know via

To apply for this job please visit

Share this :