Deforum Stable Diffusion Animation parameters

• angle, 2D operator to rotate canvas clockwise/anticlockwise in degrees per frame

• zoom, 2D operator that scales the canvas size, multiplicatively [static = 1.0]

• translation_x, 2D & 3D operator to move canvas left/right in pixels per frame

• translation_y, 2D & 3D operator to move canvas up/down in pixels per frame

• flip_2D_perspective, enables 2D mode functions to simulate “faux” 3D movement

  
  

• perspective_flip_theta, the “roll” effect angle 

• perspective_flip_phi, the “tilt” effect angle

• perspective_flip_gamma, the “pan” effect angle

• perspective_flip_fv, the 2D vanishing point of perspective (rec’d range 30-160)

• noise_schedule, amount of graininess to add per frame for diffusion diversity

• strength_schedule, amount of presence of previous frame to influence next frame, also controls steps in the following formula [steps - (strength_schedule * steps)] (more details under: “steps”)

• contrast_schedule, adjusts the overall contrast per frame [default neutral at 1.0]

"init_image":" PATH TO INIT IMAGE HERE! ",

• video_init_path, the directory at which your video file is located for Video INput mode only.

• extract_nth_frame, during the run sequence, only frames specified by this value will be extracted, saved, and diffused upon. A value of 1 indicates that every frame is to be accounted for. Values of 2 will use every other frame for the sequence. Higher values will skip that number of frames respectively.

• overwrite_extracted_frames, when enabled, will re-extract video frames each run.

When using video_input mode, the run will be instructed to write video frames to the drive. If you’ve already populated the frames needed, uncheck this box to skip past redundant extraction, and immediately start the render. If you have not extracted frames, you must run at least once with this box checked to write the necessary frames.

• use_video_mask, video_input mode only, enables the extraction and use of a separate video file intended for use as a mask. White areas of the extracted video frames will not be affected by diffusion, while black areas will be fully effected. Lighter/darker areas are affected dynamically.

• video_mask_path, the directory in which your mask video is located.

• translation_x, 2D & 3D operator to move canvas left/right in pixels per frame

• translation_y, 2D & 3D operator to move canvas up/down in pixels per frame

• translation_z, 3D operator to move canvas towards/away from view [speed set by FOV]

• rotation_x, 3D operator to tilt canvas up/down in degrees per frame

• rotation_y, 3D operator to pan canvas left/right in degrees per frame

• rotation_z, 3D operator to roll canvas clockwise/anticlockwise

• use_depth_warping, enables instructions to warp an image dynamically in 3D mode only.

• midas_weight, sets a midpoint at which a depthmap is to be drawn: range [-1 to +1]

• fov, adjusts the scale at which a canvas is moved in 3D by the translation_z value

FOV (field of view/vision) in deforum, will give specific instructions as to how the translation_z value affects the canvas. Range is -180 to +180. The value follows the inverse square law of a curve in such a way that 0 FOV is undefined and will produce a blank image output. A FOV of 180 will flatten and place the canvas plane in line with the view, causing no motion in the Z direction. Negative values of FOV will cause the translation_z instructions to invert, moving in an opposite direction to the Z plane, while retaining other normal functions.A value of 30 fov is default whereas a value of 100 would cause transition in the Z direction to be more smooth and slow. Each type of art and context will benefit differently from different FOV values. (ex. “Still-life photo of an apple” will react differently than “A large room with plants”)

FOV also lends instruction as to how a midas depth map is interpreted. The depth map (a greyscale image) will have its range of pixel values stretched or compressed in accordance with the FOV in such a fashion that the illusion of 3D is more pronounced at lower FOV values, and more shallow at values closer to 180. At full FOV of 180, no depth is perceived, as the midas depth map has been compressed to a single value range. 

• padding_mode, instructs the handling of pixels outside the field of view as they come into the scene. ‘Border” will attempt to use the edges of the canvas as the pixels to be drawn. “Reflection” will attempt to approximate the image and tile/repeat pixels, whereas “Zeros” will not add any new pixel information. 

• sampling_mode, choose from Bicubis, Bilinear or Nearest modes.

In image processing, bicubic interpolation is often chosen over bilinear or nearest-neighbor interpolation in image resampling, when speed is not an issue. In contrast to bilinear interpolation, which only takes 4 pixels (2×2) into account, bicubic interpolation considers 16 pixels (4×4). Images resampled with bicubic interpolation are smoother and have fewer interpolation artifacts.

• save_depth_map, will output a greyscale depth map image alongside the output images.

• angle, 2D operator to rotate canvas clockwise/anticlockwise in degrees per frame

• zoom, 2D operator that scales the canvas size, multiplicatively [static = 1.0]

• translation_x, 2D & 3D operator to move canvas left/right in pixels per frame

• translation_y, 2D & 3D operator to move canvas up/down in pixels per frame

• flip_2D_perspective, enables 2D mode functions to simulate “faux” 3D movement

  
  

• perspective_flip_theta, the “roll” effect angle 

• perspective_flip_phi, the “tilt” effect angle

• perspective_flip_gamma, the “pan” effect angle

• perspective_flip_fv, the 2D vanishing point of perspective (rec’d range 30-160)

• noise_schedule, amount of graininess to add per frame for diffusion diversity

• strength_schedule, amount of presence of previous frame to influence next frame, also controls steps in the following formula [steps - (strength_schedule * steps)] (more details under: “steps”)

• contrast_schedule, adjusts the overall contrast per frame [default neutral at 1.0]