Member of Technical Staff - Image / Video Researcher Job at Black Forest Labs In

Member of Technical Staff - Image / Video Researcher

Black Forest Labs is a cutting-edge startup pioneering generative image and video models. Our team, which invented Stable Diffusion, Stable Video Diffusion, and FLUX.1 , is currently seeking a strong researcher to work on model training and development.

Role:

• Training large scale Diffusion (transformer) models for image and video
• Rigorously ablating design choices and communicating results & decisions with the broader team
• Reasoning about the speed and quality trade-offs of neural network architectures

Ideal Experiences:

• Training large scale Diffusion models for image and video data
• Finetuning Diffusion models for image and video applications, such as, image and video upscalers, in and out painting models, etc.
• Deep understanding of how to effectively evaluate image and video generative models
• Strong proficiency in PyTorch, transformer models and other NN architectures.
• Deep understanding of training techniques such as FSDP, low precision training, and model parallelism

Nice to have:

• Experience with writing forward and backward Triton kernels and ensuring their correctness while considering floating point errors
• Profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight or stack trace viewers

We are an equal opportunity employer and welcome applications from all qualified candidates. We are a federal contractor or subcontractor and are required by law to provide equal employment opportunity to qualified people with disabilities.

As a federal contractor, we are required to measure our progress towards our goal of having at least 7% of our workers as people with disabilities. You can voluntarily self-identify as having a disability by selecting from the following categories:

• Alcohol or other substance use disorder (not currently using drugs illegally)
• Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
• Blind or low vision
• Cancer (past or present)
• Cardiovascular or heart disease
• Celiac disease
• Cerebral palsy
• Deaf or serious difficulty hearing
• Diabetes
• Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
• Epilepsy or other seizure disorder
• Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
• Intellectual or developmental disability
• Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
• Missing limbs or partially missing limbs
• Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
• Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
• Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
• Partial or complete paralysis (any cause)
• Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
• Short stature (dwarfism)
• Traumatic brain injury

We do not discriminate on the basis of any protected group status under any applicable law.